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PREFACE 


THIS  WORK  WAS  PROMPTED  ST  A NuMBiR  0?  EXPERIENCES  WmICh  'NDICA  ED  TO 
ME  THAT  VISUAL  PERCEPTUAL  EXPERIENCE  IS  WT  (EVER)  MERELY  A REFLECTION  OF 
THE  STATE  OF  AN  EXTERNAL  STIMULATING  ENVIRONMENT  THIS  LEO  TO  A DESIRE  TO 
UNDtRSTAND  MOW  THE  PERCEPTUAL  PROCESSES  OF  VISION  CREATE  PERCEPTIONS 
FROM  THE  STRUCTURED  STIMULATION  REAChi.xG  THE  RETINA  THE  INVESTIGATION  IS 
AS  VET  INCOMPLETE,  VIPS  BEING  AN  INITIAL  MODEL  REQUIRING  FURTHER  EXTENSION 
AND  SPECIFICATION 

1 GRATEFULLY  ACKNOWLEDGE  The  MEl?  O'  MS  MERCEDES  "SUNNY*  KOSTKAS  IN 
THE  PREPARATION  OF  THIS  MANUSCRIPT  AND  THE  HELP  OF  DR  THOMAS  MORAN  IN  'HZ 
IMPLEMENTATION  OF  THE  IMAGERY  AND  ?-R C£3TTD*J  SYSTEM. 
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ABSTRACT 


V!3S  >s  a program  (imp’emen’.ed  ,n  LIS?  i.o>  wh.ch  embodies  a psychological 
l*’’0-y  of  visu3'  imagery  and  form  percept  on.  An  experimental  \a.*  was  desi  ,ned 
whien  'equ"?d  subjects  to  pe-form  pe-captuai  activity  aver  an  extended  time  frame. 
” •?  suo.ect  was  required  to  move  a small  viaw.nj  hoe  oaout  a presented  Ima  drew. 1*3 
until  be  nj  ab'e  ! > produce  a verba:  re:a  descr.pt.sn  and  drawn  reproducton  of  the 
whole  picture  The  sub,ect  was  also  instructed  to  "t.-iink  aloud"  during  tha  hole 
movement  procedure.  Translations  of  selected  deo-iape  protocols  served  as  tha 
immediate  basis  for  V!PS  design  Relevant  resea-ch  results  of  cognitive  psychology 
provided  additional  des'gn  criteria.  Behavioral  co-respondences  between  pro'oro's 
and  equ  va'ent  traces  ot  Vi?3  activity  indicate  theory  sufficiency.  Tha  theory 
P'  oosos  that  visual  fo'm  sercepton  is  a constructive  activity  involving  tha 
c.  i'-atad  usa  of  sevo.-a!  memories  and  processes,  which  are  defined.  Tha  resultant 
visu-i  rnaga  t.ne  perception)  is  rea'iaed  by  the  integration  of  a succession  of  v ows  of 
(fixations  upon)  the  external  environment  stimu'ation.  A proposal  for  the  form  and 
content  of  s/rroolic  visual  imagery  s developed  as  a necessary  part  of  Vi?S.  A 
compar.son  of  recent  researcn  md.cat.ons  'eads  to  th?  proposal  that  flexibility  of 
information  representation  is  3 fundamental  aspect  j{  human  cognition. 
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VIP5  A V u*>  imagery  «*no  Percent  on  System; 
~n*  resu't  ot  a protocol  analysis 


Cha:fer  1.1  Introduction 

The  t tie  o*  *n  s thesis  conveys  the  dua*  nature  of  its  content  Both  th#  imagery 
s/s*em  used  to  rep'e^ent  vsuai  information  and  tne  perceptual  processes  used  to 
u^je-stanj  tne  external  \ -ua.  e"v  'O'*-"-  -t  are  investigated  These  two  concerns  are 
not  "dependent  put  rat*#',  tne/  are  fundamentally  interrelated 

'his  mtroojcto',  chapter  ♦ 's!  presents  a brief  h.story  o<  tne  ideas  about  visual 
mage'y  and  percept  on  Wn  tner#  fhiiows  a statement  of  the  goals  Of  the  thesis 
finally,  an  out  me  of  content  «s  presented  to  guide  the  reader  through  or  to  th# 
chapters  that  4o ;iow. 

1 Imagery 

hISTOPY  OF  IMAGERY 

Hager,  has  had  ts  UPS  and  downs  m psychology  Prior  to  the  twentieth  century, 
ps/cno  ogy  was  essentia  / a part, t. on  O4  ph.tosopny  concerned  with  the  wOrnmgs  of 
tne  "vnj.  The  pr.mary  bas  s tpr  any  theory  at  that  t me  was  ntrospect  on  Imagery 
and  'e  a’ed  menta  st  ; concepts  rfgned  s^pr*  «e  as  theoretical  constructs 

Cnampon*;  ©♦  S^Ch  introspective  theOr.es.  mc  uding  W am  James  and  f B 
T kroner,  cons  stenliy  noteJ  tne  mpprtant  roe  played  by  imagery  m thought  and 
per  ept  on  James  de.cr.bed  the  meaning  of  concrete  words  to  be  "‘-ensory  ima?#»v 


/ 


/ 


awahened"  (James,  1890,  p 2fc>S)  Titcnener  (1909  oe.eioped  explanations  e»  nd  ng 
this  view  to  include  abstract  term  mean-ngs  as  we 

Out  at  the  very  t me  rese  two  men  were  oe.e  oping  such  ideas,  imagery  i sd 
related  mentalist'C  concepts  *ere  Deg  nnmg  tne.r  rap.d  descent  from  prominence  They 
w err  soon  to  oe  almost  completely  aoandoned  as  viab<e  tneoretcal  constructs  in 
American  psycnology  This  rap‘0  ta  . was  primarily  the  resu  t of  the  emerg.ng 
OehaviOfist.C  Out'OC*.  One  Oas<c  goal  of  tn-s  OutiOO*  was  to  mimmi?e  toe  m*e  ent-ai 
constructs  existing  between  a given  input  stimulus  and  tre  resulting  response.  Be  rg 
such  an  inferential  construct,  mag«ry  came  under  attac* 

Imagery  had  been  already  shaken  oy  several  e*per. mental  results,  wh.cn  further 
acted  as  a cata.yst  for  the  emergence  of  bena/ior.sm.  Experiments  m the  rote  team  ng 
of  nonsense  syllables,  first  carried  Out  by  Ebbinghause  (1885),  seemed  to  indicate  the 
r .pendab'lity  of  mage  constructs  Ferna'd’s  C",9>  results  indicated  that  merr.ory 
images  were  not  actually  faithful  reproduc*  ons  of  rea  dy,  even  for  people  claiming 
“photographic"  memor,  capability  The  WurjOurg  experiments  supplied  further 
evidence  for  th.nKing  m the  absence  Of  conscious  imagery 

Such  damaging  experimental  f nd.ngs  provided  an  impetus  for  the  rise  of 
behaviorism  Behaviorism  immediately  set  to  work  to  develop  a more  parsimonious 
theory  of  thought  and  memory  nvolvmg  only  verbal  concepts  One  of  its  leading 
representatives  John  Watson  wr^te: 

"I  shou.'4  throw  Out  imagery  altogether  and  attempt  to  show  that 
practicauy  alt  natural  thought  goes  on  m terms  of  sensor -motor 
processes  in  the  larynx  [word  encodings)"  (Watson,  1913,  p.  174). 

Another  primary  goal  Of  behaviorism  was  the  objectification  of  psychological 
observation.  Thus,  the  method  of  introspection  fell  to  near  disuse  and  general 
jspicion.  At  Watson  further  wrote: 


‘'introspect  to**-*  no  essent  * ct  ts  [ps.cnc  og/s] 
metnoos,  nof  ‘S  tr,e  sc  t n*  i-c  *a  ue  of  ts  aa’a  aepen0ent 
toon  tne  reaa  '•ess  a ^ t~e,  iena  tnem.se  .es  to 
mtcrpretat  on  in  »e-^s  o*  cor  c ous*ess " >Io-d , p i6d 

L3-  .-  o»  sts  such  as  W.»*f o*»  ce  e.ea  :nat  t'-e  re-  c^s  s.stem  da  not  ha*e  even 
^ !ea  activation  incepe,'ae'‘ce.  tnat  a st. mu- at  on  jact'vaton)  oenved  necessar  » 
* r om  ?e«--e  O'gan  processes.  Tru*,  magery  a^o  "trospecton  *ere  contractor*  to 
oas  c presses 

Enper-m.^r.’a  psycho  OS  Sts  n t^e  t 'St  r*  ! C*  tn  s C€n!ur<  tended  to  *0'* 
e«du$’vei>  wd*  eas  y com'o'abe  >e'oa'  assoc  a!  0"s  as  e*per.men?ai  mater  al.  ~hs 
otte  invoked  the  use  o*  ,e  sy.aoes,  treat  ng  a s-tua' on  *n.cn  * r0t 

conducive  to  t^e  use  0'  *eport  o*  "-ag er,  (Pa  . o,  *97i'  Th,s  research  f'a^ewor* 
played  a S'gn.f.rant  roe  m reepng  m*ge'y  OO'^ant  n psychology  in  contest,  tne 
sever*'  ntrospect  >\e  resets  of  tne  pe-  oa  st  u*  red  -age  consVjcts. 

Abound  i960,  imagery  began  to  re-emerge,  due  to  an  accumg'at-on  of  Doth  positive 
ana  facto*s  Eiper  ment*  results  m<j.cat  ng  tn«  e«  stence  and  use  of  imagery 

provided  the  positive  factors  Tn*  growth  of  psychopnarmacoiogy  and  sensor 
deprivation  researcn  provided  numerous  reports  ot  nai-ucinatory  images.  NeufO'og'C*! 
nvestigat  ons,  part  cularly  those  involving  o *ect  Stimulation  if  the  brain  (Penf-e  d and 
Jaspers,  i954),  also  provided  reports  of  imagery 

Concurrently,  the  goa's  of  psycho‘ogical  research  ewperien-.ed  radical  change 
"ne  goal  for  research  roar  became  the  ree'iiaVon  of  delated  and  operative  mode's  of 
the  oenavng  organism.  Mode  building  had  not  been  a goal  of  either  introspective  or 
behavioristic  psychology,  but  d-d  borrow  criteria  and  f**hnique*  from  both.  Model 
inputs  and  Outputs  cou'd  be  checked  objectively  agamst  data  (behavioristic),  but  the 
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psychologist  agam  Decade  a source  of  cnecss  for  tne  moue  as  designer 
(introspective).  This  provided  a framework  (or  trie  incorporation  or  imagery  into  an 
objectively  measured.  modt'i -Paced  theory. 

Tne  emergence  ot  comp..;  ng  machinery  and  tre  early  sjcvessfu!  developments  ot 
art  f c .1  nteM/gcnce  served  to  tor-*.«»d  the  . e*  of  human  t naught  an.-.  • apt  on  as 

oe-  j activities  ot  nfo-mat  on  process  rg.  Tn.s  menta  .stic  OutiOOk  provided  (urtner 
grounds  *Or  renewed  invest  gat  on  Of  imagery. 

Negative  factors  we-e  a'so  ■~.a  veo  - -mage'y's  re-eme'gence  "he  o*  ma-y  o-e 
was  a growing  dissatisfaction  * th  tne  progress  of  bena  o-sm  is  J B ge  ssi  11970) 
notes:  “tne  nc  -.ense  syi  aole  nao  had  ts  day"  . ana  "tne  promises  of  behaviorisis 
remained  unturned"  This  a ssat'sfact.on  ed  to  a c cse-  scrutiny  ot  :-e  arguments 
against  imagery  anc  the  -eai  oation  that  n some  ways  tney  were  vacuous 

Tne  inaccuracy  of  visual  memory  r.ad  been  he>o  o as  a osproo*  of  visual 
imagery.  3ut  all  modes  of  memory  hao  repeateay  been  shown  lo  be  inaccurate,  not 
lust  visual.  Bartlett  (1922)  noted  this,  character  oing  memory  as  a partial  construction 
of  rcrai  fy  and  not  as  a reproduction  Bar’  ett  was  one  of  tne  *ewi  psychologists  oi  tne 
Imp  to  give  imagery  a role  m numan  oenav.or 

"he  reaW?at  on  also  came  that  vercaiiy  oriented  thought  processes  were  as  much 
inferred  or  implicit  as  those  using  imagery.  Ve'Oai  responses  couid  be  ,ust  as  we. 
med.ated  by  inferred  mentai  images  as  by  'n'e'red  mental  words  In  fact,  results  which 
indicate  the  emst'-ce  of  visual  recognition  memory  m infants  provide  an  example  ot  a 
visual  memory  (imagery)  with  the  possibility  of  a verbal  encoding  eliminated  (Fagan, 
1972).  A third  factor  was  that  verbal-based  theories  were  not  necessarily  more 
parsimonious.  In  visual  recognition  tasss  and  visual  matching  tasks  one  indeed 
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appealed  ‘3  ce  o'Opos  ng  unnece-.sa'>  p-ocess-ng  n the  act  of  translating  a nput  to 
ra^«»s  or  \ e'ba  descriptions  for  co^pa'-so" 

t»per.m«»nts  not  ng  reason  \.r*e  d'f»«'r*ces  between  name  and  /isy*:  same- 
o »*ere-*  compa*  sons  of  vista,  v presented  st»mu  have  produced  resu-ts  fa.oraoe  to 
mag*-,  ' -e's^y,  1 ?69.  Po1  nt»r  and  ✓eee,  1966,  Posner  and  Mitchell,  196  '»  Other 
e«per  n-ents  mvo  no  concep*  assoc  at  ons  na.e  appeared  ,0  |f,9‘C«>te  tnc  utmzat.on  o* 
non-wo'o,  mag  "a  med  ut-ors  tPa*v.o,  1971).  Pa  o (19'M)  has  presented  a most 
va'uoe  survey  ana  d scuss  on  of  experimental  resu-ts  re'evant  !o  imagery  Other 
recent  oooKs  iRchardson,  1970;  Segal,  1970;  Chase,  1973)  present  further  resu-ts  and 
thought  ^e'evant  to  imagery  anq  the  processing  of  visual  information.  Imagery  has 
returned  as  a concept  to  oe  investigated  m cognitive  psychology. 

MEANING  of  "IMAGE" 

Wnat  is  tne  mean  ng  o‘  tne  concept  "image"  (or  ".magery")  7 Tr.e  ta>r.  ol  de’T.t.on 
has  rot  pro/en  easy  tor  ps/choog,  Ac'Ofd  rg  to  a consensus  of  d-et  onary 
det  ritions  an  image  is  a mpnta.  repro-iontat  on  or  m-tat.on  ot  an,‘hing  fn-s  definition 
is  not  adequate  for  present  ps/c  oogcal  purposes  As  further  interest  m imagery  has 
de/e  oped,  problems  conccrn.ng  .ts  p-ccse  aefm.tion  nave  arisen. 

Two  def»n  t-ons  representative  of  differing  approaches  to  the  specification  of 
imagery  foiow  The  moda'ity  approach  to  the  oetinilion  is  illustrated  as  follows, 
defin-ng  the  image  Or  imagery  as: 

"non- verbal  m-emory  representations  of  concrete  objects  and 
events,  or  non-verbal  modes  of  thought  (e  g .imagination) 
m which  such  representations  a»e  actively  generated  and 
manipulated  by  the  individual  " (Paivio,  1971,  p 12) 

The  second  approach,  one  stressing  modality  independence,  is  as  follows: 
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"The  tunct>on  of  memory  imagery  is  to  put  u»  m d-rtct 
contact  with  HOW  tnmgs  looked,  or  sounoed,  or  fe*t,  or 
tilted,  at  distinct  from  WHAT  they  reserved,  what  they 
sounded  like,  looked  i*e,  felt  or  lasted  luce  " 

(Bower,  1972,  p 51) 

Neither  definition  is  satisfactory  Pa>vio's  definition  leaves  open  the  critical 
question  of  how  to  distinguish  between  "verbal"  and  "non-verbal"  representations  m 
the  head  This  definition  of  imagery  drectiy  confronts  problems  of  epistemological 
status,  ambiguity,  and  possible  contrad>ction.  Bartlett  notes  these  problems  to  result 
from  the  fact  that- 

"most  statements  that  na.-e  Been  made  about  -mages 
in  traditional  psychology  concern  their  nature 
ratner  than  the-r  funct-On,  what  they  are  ratner 
than  what  they  make  it  possmie  to  do**  (Barhetl,  1932,  p2l5). 

Bower’s  def-n  'ion  also  relies  heavily  upon  phenomenological  intuition  for  its 
meaning.  Bower's  definition  agam  concern  pnma-  / tne  nature  of  the  m age  ana 
lace.  the  same  problems  as  Paw-o's.  Furthermore,  f fa  s bf  implying  teat  tne  -mage  s 
an  oternaiy  ooservabie  entity  offering  a means  of  “direct  contact"  w-th  sensory 
related  information  A /isua  image  is  not  what  the  wtt*e  man  sees  ms-dc*  but  what  is 
inside  tne  littie  man  that  sees 

Even  accepting  these  two  det  nit-ona-  specifications  as  being  adequate  does  not 
yield  a favorable  situation.  The  differing  degrees  of  importance  placed  upon 
representation  modality  leads  to  differing  and  d vergent  e»per-mental  concerns  Thus, 
Current  imagery  research  is  bc-ng  conducted  without  the  benefit  o!  an  adequate  and 
accepted  definition  as  bas-»  Cash  investigation  m.^st  attempt  to  clarify  the  concept, 
both  as  a preconsiderat>on  and  as  a result  for  discussion 

The  definition  offered  here  specifies  the  structure,  content,  and  function  of  the 
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•mage.  An  mage  (m  general  ,%  an  internal  symbol  semantic  representation  of 
nformation  which  it  capable  of  determining  <gud'n|)  behavior  (enabling  a response), 
and  which  has  an  internal  moda  ty  characteristic.  “Semantic"  her*  means 
“meant  mugful".  In  the  case  of  an  image  remit. ng  from  perceptual  activity,  “semantic- 
imp  .es  that  thu  input  meaning  is  preserved  in  the  representation,  though  not 
necessariiy  m its  enact  lorm  or  order  That  the  information  of  an  image  «s  adequate 
for  behavior  determination  mo  cates  a oas<c  functional  equivalence  between  the  image 
end  sensory  input  Gart-ett  u93?)  notes  *n.s  ab-l'ty  of  imagery  to  free  human 
behavior  from  strict  dependence  upon  the  continuous  tempora  sequence  of 
env-ronmenta  sensory  input. 

Images  a-e  but  one  form  ot  representation  w.tn.n  tne  internal  "sensor,  oroer" 
The  "sensory  order"  (Ma>e*.  1952)  Dears  a i<m.ted  (but  often  sufficient) 
correspondence  to  tnf  "pnysca  ofde'"  o’  tne  eife'^a  environment  “me  eements  o* 

th  s interna'  represent  0"a  order  ce  e o?  to  »efe;:f  dt*eren(Ps  retween  sensor> 

mpuf  wh-cn  a»e  necessary  *or  t^e  rca  /at  on  of  aoea  ate  Success*..  oeha>  or  Tne 

"ra  son  d’etre"  of  any  mage  s to  co*  cie  a bass  tor  adequate  oe^a.  or 

The  mterna'  moda  ty  cna»a:ter.sti(  dstngusnes  mages  from  ot "e* 

reprt*  enta?  ons  of  mean.ng  and  pr0v  jPS  4 bas’C  »e  at  onsn.p  to  an  associated 

perenptua  process  isen<.0*  » mo J a it,)  A"!  Operat  ona'  or  functona  oe*.n  t un  of 

nternai  moda  dy  nas  been  sta'ea  o,  S " On.  as  fO'Oas 

" nfo'mat  on  s s!o»*“  f n «.jfn  A t*»a!  t can 
re  'et'ie.ed  r,  proces'es  ^C'l'O’pnc  to 

l*e  e»?erna  processes  t -at  *»e  j«eo  'o  re?r  e t 
on  n *rP  C0'»esr0"3ng  *>OdJ  ty  •rO'*' 
eiternai  r.Ou'ces"  i$  "O^,  ,9“?,  pi^’i 

“nere*ore,  tne  n»ormat  on  w tn  n a ••age  Of  a g\en  m-Oda>ty  S structured  to  re 
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effectively  .md  etlic>en!iy  istra  ght -forwardly)  retrievable  Dy  processes  isomorphic  to 
those  of  that  pe'ceptua-  modaMy  Tne  inform  *on  .s  "perceptua  iy  structured"  The 
moaa  ty  attribute  of  an  mage's  mformat  on  structure  provides  a means  for  tne 
evai uation  of  .>ny  proposed  vtsua>  mage  representation 

VISuAl  iMAGl  SPrUFICATION 

Tn.s  genera  mage  det  n.t.on  must  be  turtner  qualified  m visual  terms  to  be 
su*t.;  enf  for  tne  purposes  of  tne  thes  s As  a f.rst  step,  the  visual  imaga  «s  defined  as 
tne  inte'nj  semantic  representation  of  viSua-  information  capable  Of  deterrrumng 
visuanyre  ated  behavior  if  rema  ns  to  spec  fy  v ;uai  >nform3tion  and  visua  ly-re  3ted 
behavior  n order  to  complete  tne  definition 

rh«  information  w>thm  a visual  image  s structured  so  as  to  bt  straight -forwardly 
acce  s b e by  processes  somerpme  to  those  when  access  external  information 
(sensory  stimuiat.onj  Our.ng  visua  oercep‘  on  Vsuai  st  mutation  is  accessed  by  a 
ser  es  of  spa'-ai  y re'ated  samp  ngs  fscann  ng  dur  f>g  visual  perception  V-suai  image 
access  must  t>e  .somorpn.r  n mean-ng  to  v-Sual  scann  ng  A visual  mage  therefore  has 
an  .mp'ic  t,  spat  ally  defined  po  nt  o*  * ew  Infernal  modality  produces  a cr.terion  tor 
tne  content  and  structura1  cha'acter.st  cs  ot  tne  visua-  mage,  and  *nd>cates  an  -nit  a 
nterreiaf'On^t  p between  tne  v »ua  mage  and  the  visua  perception  process 

St"l  to  be  speed  ed  a»e  tne  masses  of  informations  vai.es  tsymbo-si  mpedded  n 
the  pe’ceptua  y-basej  structure  Internal  modality  nt  0en<es  tn.s  mage  property 
also  Neuro'og-ca*  e«perimpn‘atiOn  has  nq.cated  the  teature  detection  capab  t es  of 
the  frog,  cat,  and  monkey  vps.on  (e/e>  systems  (Lettv.n,  et  a',  1962;  Hube'  and  W esse!, 
1962,  1965,  1968)  Psychological  and  psyehophys-cai  results  have  indicated  similar 
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abi  t>  and  activity  within  tne  nuna-i  viO"  system  (Bar t'ett,  1 932  i M We«sste  n,  1973) 
Therefor©,  on*  c'ass  o*  nformaron  values  mbedded  <n  the  visual  image  is  that  of  the 
symt.os  represenfat  ve  of  detectable  vsua-  features. 

Tne  other  class  of  mage  symbo  s s best  specif  ed  through  a definition  of  visually* 
re  ated  behavior  The  visual  image  may  serve  as  a sou^t  of  ^formation  to  |u<de  two 
basic  .vpes  o*  act-v-U  Oe  s motor  activity  wtnm  a ocai,  soatiai  environment  Tn.s 
includes  no?  on.,  cOO'd  nated  physic  a>  noi,  action  , but  aso  the  contro>  of  the  head 
ana  eye  movements  assoc  afen  « th  the  v.sua  percept  on  process  Tne  other  type  of 
a t - ?,  s cognitive  or**  or  invoking  spat  a and  visual  feature  content  £«iwp  es 
are  fhe  arch.tectura’  p ann.ng  and  veroa  descr  b-ng  of  a spatal  (visual)  environment  or 
scene  The  me  ogn  t »a  e^a^oe  s v sua  'O'm  perception  A visual  mag*  .*  the 
bas*'.  for  percept  u»  >n«e'fi:es.  n/pot  , and  eipectat.ons 

To  be  adequate  tor  t^c  aetcrm.natiOn  of  trese  behaviors,  a c ass  o»  spat. a- 
nfor^at-on  values  (sympos)  rr.jst  a so  necessa'ily  oe  mpedotd  nto  tne  structure  of 
the  v su»  image  Va  ues  suff : ent  for  the  specUat.on  of  position,  j.recton,  and 
d'Stenc#  (range)  na»t  up  tn.s  c ass  o*  spatially  mean.ngful  symbols  lee  3roo*s 
< 1 963. i 9 73 » nas  reported  rese  ts  from  se.eral  tas*  interference  e«permen?s  *n.ch 
no  cafe  both  the  e»  stence  o*  nte»nj.  memory  moda^t  es  and  th#  spat  a content  of  t^e 
internal  visual  represent*?. o*  *rrse  results  a so  .no, cate  that  maging  in  a modality 
nterferes  w.th  activity  .n.Oivng  perception  .n  that  moda>ty  The  nt*rterence 
md  cates  tne  c>ose  re  al>onshp  Detween  mage'y  anj  perception 

In  ronefuson,  t*e  fully  spec  * ed  detirvt.cn  of  tne  vsua1  image  s th#  internal 
semantic  representation  of  spat  a and  visuef  feature  i«*ormat  on  , structured  so  es  to 
be  stre  ght -forwardly  retr.ev#o>e  by  interne!  processes  ispmorphic  to  those  of  visuoJ 
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perception.  A visual  image  >&  furthermore  capab  • of  acting  as  a bass  for  motor  and 
cognitive  behjvior  with  regard  to  the  visual  environment  represented. 

The  visual  percept  on  process  nas  a fundamental  definitional  influence  upon  the 
structure  and  content  of  ‘*e  visual  mage  The  visual  image  has  a correspondingly 
significant  effect  upon  tne  perception  process,  acting  as  as  an  informational  guide  for 
the  perceptual  activity  The  image  serves  as  source  of  feature  expectations  and  eye 
(head)  movement  control  specifications  du'>ng  visua1  perception.  Finally,  perceptual 
activity  is  a primary  source  of  v.iuai  images  Tne  resultant  perception  of  the  current 
environment  is  a visual  image 

VISUAL  IMAGE  ClASS'^lCATlON 

The  degree  of  correlation  with  external  events  is  the  determining  factor  for  one 

scale  of  image  classification.  In  order  of  decreasing  external  correspondence,  e visual 

•mage  may  be  classified  as  a perception,  an  illusion,  a hallucination,  or  a dream, 

memory,  or  mantel  image.  As  Segal  states: 

"When  we  have  been  ab'e  to  ascertain  that  a given  impression 
shows  adequate  correlation  with  external  events  to  satisfy 
Our  current  needs,  it  is  conventional  to  cell  it  e 
’perception’ . " (Segal,  1970) 

Another  compereoie  classification  is  based  upon  the  degree  to  which  an  image 
depends  upon  external  (sensory)  as  opposed  to  internal  sources  Ot  information  for  its 
content  (Horowitz,  1972).  At  one  end  of  the  scale,  dreams  or  mental  images  rely 
solely  upon  internal  information  sources.  Richardson  has  defined  mental  imagery  to  be 
those  corneous  mental  experiences  which  "exist  for  us  m the  absence  of  those 
stimulus  conditions  that  ere  known  *o  produce  their  genuine  sensory  or  perceptual 
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counterparts'  (Richardson,  1970).  However,  perceptions,  at  the  other  and  of  In*  seal*, 
do  not  r».y  coaly  upon  eatemai  .nfc'iraliOn  Goals,  expectances,  and  experience 
(internal  statas)  hava  consistantiy  baan  srown  to  p<ay  significant  roles  in  the 
real  zat  on  of  perceptual  images  and  to  effect  lna<r  content  (Berkeley,  i 7 10c  Segal, 
1 970;  Chase  and  Clark,  197?) 

These  image  classification  scales  must  oa  cont  nua,  * th  the  boundaries  bet  naan 
each  Class  remg  indistinct.  The  c awe.  and  olten  repeated,  study  by  Perky  (1910) 
has  shown  that  the  conscious  experience  of  imaging  and  perceiving  are  not  noticeably 
distinct.  In  that  study,  perception  is  mistaken  to  be  imagery  As  for  the  inverse, 
studes  by  Goldiamond  and  Hawkins  (1958)  nave  shown  mat  imagery  can  be  mistaken 
to  be  perception.  Visual  perception  and  visual  imagery  appear  to  be  inseparably 
entangled. 

2.  Visual  Form  Perception 

As  visual  imagery  end  perception  ere  to  interrelated,  consider  row  several 
proposed  theories  of  the  objective  visual  perception  of  form.  Note  that  visual 
percept  on  has  been  narrowed  to  the  area  Of  form  perception.  The  thesis  is  not 
directly  concerned  with  brightness,  color,  or  novement  perception,  though  these  mat 
be  basic  participants  and/or  resultants  0*  form  perception.  The  thesis  is  as 
investigation  of  how  the  representation  of  the  environment  as  tpetiatiy  interrelated 


forms  is  realized 


12 

Classical  tufout 

Gass.cai  Of  atom.stic  theory  proposes  that  the  visual  perception  ot  form  is  an 
"unconscious  cO"C  uSO"  'eared  by  > onsoOus  inferences"  when  ere  baseo  upon 
me  a ues  of  tne  sm*  .est  dscrinvnypie  or  homogeneous  patches  of  the  st  muius 
(Mpirnho  t/,  1 96? t Tne  'a»  cOifl’  se"sat  on  atoms  a-e  automatically  assoc  ated  w.tn 
and  reca'I  the  non  vsuei  sensations  ot  form  The  inferences  are  Desea  upon  pre- 
e«i$tent  knowledge  o'  a "estnet  c,  lactue,  ana  eyemovement  experiences  when  h« 
ejccme  associated  win  the  sensations  (Gregory,  1970) 

One  source  r t criticism  '0'  *ne  theory  IS  the  proposea  unconscious  nature  Of  the 
perceptual  inferences  Tn.s  seem  rg  y implies  that  the  process  is  "Ot  anaiyrabie  end 
met  any  '"te'rr,eda*e  stages  o'  process"!  a"0  information  representation  are  not 
detectable.  To  the  contrary  -ece"t  research  has  indicated  the  enstence  of  severe 
perceptual  itefes  (Sperling,  i960,  Stemoe'g,  1967) 

Another  prob.em  for  tne  tneor*  is  me  evidence  tor  the  feature  er  ’act  on  aDOity 
and  act  vity  of  the  vision  system  noted  above  Thus,  the  basic  visual  sensation  s not 
Of  the  form  of  a retinal  picture  o'  homogeneous  color  atoms.  Furthermore,  there  IS 
evidence  that  distance  features  may  be  included  in  the  "sensation"  Barlow  U967)  "as 
determined  that  there  >s  retmai  activity  direct  y responsive  to  sufficient  location 
disparity  between  light  input  to  the  two  eyes  Distance  perception  is  therefore  not 
solely  a result  Of  "unconscious  inference"  as  is  proposed  by  the  classical  theory 
Classical  theory's  account  o'  depth  perception  had  been  one  ot  its  major  explanatory 
successes  (Gogel,  1998). 
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gestalt  iMeoav 

Gesta-t  theory  deveoced  as  a r t«on  ?o  atom  s!  c ! eor,*s  t«  .ure  to  ro'c  .»•  j 
t»p  i’n  me  e*fect  o*  «•!  mu  it  on  co"!e«t  upo^  ' e a 0"  o*  st  mu-a’-O'*  .flow 
Gestalt  psycho  og,  v ews  vswa  percept  0M  to  oe  tre  «c»sut  ot  be  app  -to''  o4  m^pr 
O-gan  zabona  a*s  to  tne  cO">p  ete  encc unified  s„*  * e-d  S-  '*+■'  a prO«  m*r, 
S'~  anty,  contnuty,  ana  rosu'e  are  ca*  "fi  to  ce  t-"e  ‘unda**  e^T*.  oases  ot  *o"n 

pe'cepton  Tnese  aas  predct.  * tn  a ngn  aeg'ee  0*  sat<*Urton.  aintch  o*  wan, 
*oj'C»lly  poss  -b'e  perceptual  organ zat  o«s  w r tact  or  rea  zed  *0'  a g en 
pretenWo  v-sual  t>eid  i^ott-a.  1935* 

One  great  proo^em  tac.rg  Gesta-t  tneor,  s tre  spec.f.cato"  ot  me  e proposed 
Organization*!  a*s  *n  terrrs  *n,ch  *’e  not  were.,  ntyt’/e  9ea»>/ation  o*  tn  s problem 
has  'ed  to  attempt*  to  quant  4,  trese  a pects  o*  tre  v.sua-  en/ ronrrent  One  such 
approach  has  been  to  app  , n!orw*r.on  tneoretca*  techniques  »n  tne  an*,s*  ot 
presented  visua*  environments  Atmeave  (1954,  1559)  prodded  the  t.rst  cowpete  y 
developed  attempt  ot  sucn  an  approacn,  cons  aer.ng  the  visual  t*e'd  »n  terms  ot  »ts 
contan#d  redundancy 

Other  similarly  der.ved  weans  tor  precise^/  defn.ng  the  Gestalt  organization#  laws 
ha/e  concerned  themselves  w»|h  measuring  the  amount  of  information  necessary  to 
describe  or  specify  a figure.  The  probability  of  perception,  given  a presantto  f>eld,  is 
than  seen  to  be  inversely  related  to  such  an  information  measure.  This  principle  of 
perception,  derived  from  Gestait  origins  as  noted,  has  been  called  the  "minimum 
principle"  Hochberg  has  been  involved  *n  several  attempts  to  #*plan  the  three 
dimensional  perceptions  Of  straght  line  drawings  m light  of  this  minimum  principle 
(Mocnberg  and  McAlister,  1953;  Hochberg  and  BrooAs,  1W0).  The  problem  of 


14 

adequate  y specify  ng  tne,e  .ntu'tive  organijat ,al  laws  nas  not  yet  ocen  <olved  Any 
measure  of  stimulus  ct~aractenst.es  wpon  whch  to  base  the  Gestalt  law  performance 
necessarily  introduces  that  measure  or  information*,  encoding  as  an  intermediary 
construct,  a foreign  add  lion  to  the  bas«c  theory  propos* 

Another  probem  tor  Gestalt  theory  is  that  the  organisational  "laws"  are  not 
actually  determinants  of  beha/iOr  An  observer  can  voluntarily  reverse  f.gure  ana 
ground  or  choo'e  oetween  ai’ernat  ve  f'gurai  perceptions  The  means  for  such 
Clivdies  are  not  part  of  toe  Gestalt  theory  of  perception. 

One  final,  most  mpo'tant  fa  'ure,  is  that  the  "wnoe"  to  which  the  laws  apply  is 
not  specified  or  readi  , spec  fabe  Tne  fact  igno-ed  by  Gestat  perceptual  theory  is 
that  a figure  (object)  is  normally  perce, ved  through  a succession  of  glimpses.  Partial 
tigural  regions  »re  fovea'iy  ♦ <ated  at  different  t-mes  Pact-ai  regions  may  have 
Sign  ficant  effects  uoon  the  compie’e  f.gura'  percept  on  (S^on,  i967,  Hochberg,  1963. 
Gregory,  1970)  If  Gesta  t aw  are  only  app  icable  to  the  total  vsu*'  f e'd,  the  effects 
of  tfese  part.ai  reg-ons  are  not  eip'aned  If  tnese  smarfr,  conta  ned  reg  Ons  are  the 
"whole"  units  for  law  app  icaton,  Gestat  theory  fa  Is  to  offer  any  means  Dy  wf  to 
>ntef/ate  then  nto  compete  ene  percept  ons 

i-ORMAc  Ar*i)  MLChA’jJCAl  PA t T t M.’i  i’ECO&YtUGft 

he  program  .r.p  a!  0"  ar*Ci  mafr-rr,  at, fa  form.i'./at  On  Of  twO  me*  non  ■ Of 

pattern  tv'  cigmT.on  r>fW  aV  '.f>r*e  ,nr.**r»»»'J  apar>..<‘  «•*,  and  n tatcms  O*  thr'.e  as 
pos*  t»>e  e»p  anat-on*.  of  /<•. wa-  form  pe'cept  on 

'rnp.ate  matching  war  one  of  the  car  est  methods  0*  pattern  rerogn.t.o*'  to  he 
implemented  (Wau  now,  19b;>  A tm,  ,us  s matched  aganst  a ',*t  ot  rccogn/abe 
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patterns,  with  the  "best  match”  be-ng  the  one  r#cogn?#d.  The  method  was  founa  to 
have  limited  applicability  doe  to  tne  adverse  effects  upon  performance  by  small 
variances  of  form  and  increasing  recognition  set  * *e.  Nesser  (1967)  discusses 
template  matching  as  a possio  e e«pianat>on  of  form  perception  He  notes  significant 
problems  in  accounting  tor  Observed  recognition  nvariances  over  retinal  position,  si*e, 
and  orientat-on  (m  some  c*  es) 

Severa  ea*1y  pattern  recognit  on  p-opams  were  based  utan  feature  e^tract-on 
These  systems  incorporated  ab...t  es  to  create  ana  aa  ost  feature  operators  (Lnr  ana 
Voss'er,  1961),  to  adjust  'eature  *eignt-ngs  (L.  G ttooerts,  i960),  and  to  fO'm  vaiuab«e 
feature  combinations  (Se'fr  ctge,  1959)  ~nese  at>  t es  have  been  recently  red<scwssed 
by  Uhr  (1973)  A mathematical  formal*/ ation  of  this  method  has  indicated  severa' 
inherent  lim.tat-ons  tPe  ceptrons  ; Mns*/  and  ^apert,  1969)  A system  us.'* 
a ametor  cov.ncjed  'eature  extractors  *.  ncpabie  of  deter  ft  n.ng  pattc'n 
<onr»*ctedner.r.  Pecog*'  * on  n co-te«t  s borond  ;^e  scoj*  of  a system  based  so'-eiy 
upon  feature  extract  O'* 

AN  ALTtSNATJVE  CONS  * ■ iVc 

T re  C assia  a"3  Ciest*  * t'-ecres  o*  form  percept-on  and  the  te-  p a*e  and 
feature  extract. met nods  o4  pat'er-  recog-ton  ,>re  a teen  to  n*.e  te* 
s^o,4com  rjj  a*  t-eoret  a rxpa-a’ons  in  atr  -a'  e theory  has  been  oe  e op  ng, 
based  upo-  t-e  ro  t c ana  »■*£*•  e 'e-wt  ge-p'«i'ej  b*  Ve  tneor.es  ano  -'et’'Ods 
rise  sed  tn.  tipos  s ca  c*d  ?m  convl'^ct  e t’*eor,  of  visua*  form  perception  It* 
Da  ( prp”  O S 4,'at  t'O  act  !,  0*  *Orr>  pp'.ep*0»'  S W (dnst'UftiOn  of  an  <nte»na. 
represent*’  on  when  v* nod  es  ?/»e  structure  iccmtpnt'  o»  t*e  externa  v • -^a- 


environment  (the  perception'  This  constructive  > ! t olvt*  the  integral  .••  ot  a 
sequence  Ot  mforr.  at  onai  nputs  aer  ed  from  d ^er  s V t*,e  * «jtions  upon  the 
enternal  environment.  flepresentat.on  co,“.truct>on  aces  not  imp!>  t^e  continuous 
generation  ot  new,  -n.q0e  symoo  structures  Tn,s  cor  • ..t  on  .nvoives  tne  selective 
act.at'On  and  a'  o at  on  o»  pre  e»«stent  images  or  ,n-age  components  tsymoo's  ana 
reiat  ons)  Tnat  un.que  (not  p'e  ousiy  see-')  *»n\  on  meets  can  be  perce  >eci  »u.  ates 
the  ability  to  create  ne*  sl’yctu'es  trom  a t aoe  components  to  construct  a -<suai 
-mage  Thai  new  visja  discrimination  can  be  ea^ea  .nd  ates  tMe  ability  to  create 
near  components  tor  image  construct  on 

Tne  con  itruct've  tneow  o<  .-sua  percept. on  provoes  a stra  Rhl  forward 
e«pianatiOn  »or  tne  effects  Of  nierna  states  (<e  goas)  upon  percept  on  Goa's  can 
effect  the  selection  of  act  sated  n age  components.  t»pe- e«ce  nas  deter * red  those 
components  which  are  ava  at  >e  'O'  r age  ncorpoot  on  App'op*  ate  *no*'eagr  ray 
he  activated  to  compensate  ’ .'"OnoOuS  St  mulat  on  "J  cat  Ons  il/.ifi  PC’  .ept  on 
Tne  effects  of  water  (h  e cent  stc*  p-eno^e-o-  and  e, eg  asses  <coo'ed  o* 
pr.snat.c)  can  p«>  a*s.n  ‘ate  .n*o  ’'e  image  to  .hjvton  $m  a*,,,  »-e  ah  f*  *o 
voluntarily  a'ter  tne  per:ept  on  0*  an  ?n/  fOnrrent  p'ese"ts  no  p'ODe-'  ‘or  the  fneor, 
Tne  resonance  theory  o*  percept  on  Gosor,  ; 966)  p'OpO'e  'm!  percep*  o~ 
resuts  from  a d.rect  ana', s'-,  of  ■?  mj. a*. on  sVuttufe  |n  c**»a'f  to  t^e  en  frue*  e 
tneOry,  resonance  theory  f-n? 0 .nte"  c|M.f  jfy  n • e e«p  A«*tiOn  O’  t*r  ''•♦ec'S  0* 
nternai  state'  ana  tne  an  fy  to  'O'unfa'  / a *ef  percept  Ons  Pa’^e'  * an  t e np,  a 
p|i(*r  jmenon  of  resonance,  v j.«  p*»rc**pt  On  is  better  d<  r.ljfij  a1,  a r»*H;n  *• » M 
interference*  or  nteract  on  be*  ween  n*ern,e  Mate'  anrj  *rn'Or,  ' at  on  a c, 
(194£)  has  even  described  internal  .uai  represent*?  o—.  as  a fo»m  of  “r-v»*i 


i*rt»n<  o 


17 


wa  e patterns"  Tha:  p'Oposa  s -ot  maoe  he'’*,  but  construct  v*»  activity  tn-ou«,n 
ass  n a*  on  and  accomoaat  on  can  oe  deseeded  as  a form  of  interference 

Hebo  <1949  oegan  tr.e  mooem  ps*cho:cg.ca.  formulation  o*  a constructive 
treo-y  O*  form  percept  On  reoo's  model  includes  tn#  .ntegrat  on  of  inputs  and  the 
direct  on  of  eye  attention  as  bas.c  cements.  He  proposes  two  e asses  of  h gher  order 
rear  a units;  cel)  a-semo  es  a^o  pnase  sequences.  Ce  assembles  are  groupmgs  of 
r'e-'ons  *n.cn  a»e  * 'eo  ^eQuen:  y ana  s ma  tjneOuS  y Oy  h.gh  probably  stimulus 
pa**  its.  Prase  sequences  are  tre  furtrer  ,o  n,rg  of  $e*era  such  cell  assembl  es 
vs.''  n a.e  0*t*"  actva'eo  n tempos  seq-ence  This  ,0'nmg  acts  to  fac  >tate 

Sw  - sec  e«t  a.  ? • -g  \so^e*  at  -e  an  e*pectat  on)  ana  to  a rect  attention  upon  tne 

e-v  'O-n-ent  to  accomp  sn  t-e  same  Ore  prooem  s tnjt  nebb's  proposa  aoes  not 
'f  ile  d rect  , to  a e e of  senso'.  mpj,  o"  > cea  carded  :e"*'a  processes 

' -e  j*'  : ce  j*  n»o*»»  y ■«  -'ef/at  cn  3-r  -g  pe*cep*  o**  s nt'jauceo 

an  Mocncf  ^ . •Ic'A. . * J,*  9 ' j 'as  te.  a prra*,  ' fcu'e  n f*e 

n.e  *»;a*i  a^c  t*i  ? a*  O'*  o’  **e  cons*<*^t  e ''e«',  proposes  ’ a'  a :>as  c 
a pe*t  0*  Sua  pe'cepf  O'-  s an  -ce'  , "g  s?*wttufa.  orga"  pa*  0"  w*'  r-a-.es 
ooss  0 e t'ie  so  ec*  e a*!e  ' o**  upc-  and  success  e nte-;»at  on  o»  tne  s sua 
e-.  o-me-t  ’n  <,  c'ga"  ;«•  5"  s e-ooaea  c.  "scvniat  c - aps"  w * cn  a*e 

O'*  • ’ * »*: *e 3 to  gu  ce  v*e  re-  t-pv.a  a;’  *,  *rese  -*aps  a'e  genp'afea  a:cora  -g  to 
orr;a-  /a*  ona  a**.  c*  re*  a a e»pe' e^ce  ra  Gesta!  v"*-.*  r».,m  p».ncipe"' 

0-  a " 

' ess  a.-e-'s  a-  aVe- p's  ‘o  r^'t-e'  spec*,  'ns  ? e?»e?  :a  p’Coo>a 
e:  a*e  ' e ■ c »*  c w ’*■  a ass  o*  s.,a  * a;es  ' * a 'o*m 

pc'ft'P*  0"  ’ .♦•*  i • * i .*  o*  . -v  a*  . n ap"  cpn.rpt  ana  of  Is 
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role  m cognition.  The  perceptual  image  is  constructed  both  as  guide  for  the 
perceptual  activity  and  ar>  product  of  that  behavior 

3 Goafs  of  the  Thess 

The  research  wh.ch  is  reported  here  «s  a further  investigation  and  specification  of 
tne  constructive  theory  of  visual  fO'm  percept. on  Wore  spec  ficaily,  the  goals  have 
been;  (1)  to  investigate  the  nature  of  the  processes  and  memor.es  which  are  involved 
m tne  fixation  and  integration  of  success  ve  views  of  the  environment;  (2)  to 
investigate  the  nature  of  tne  internal  representation  {symbolic  visual  image)  which  is 
capable  of  embody  ng  the  necessary  partia'  and  comp.ete  perceptions;  <3)  to  specify 
the  results  of  the  investigations  m the  *orm  of  an  operational,  computer -implemented 
visual  imagery  and  perception  system  (VIPS).  VI?$  s sucn  a program  which  has  been 
implemented  <n  LISP  i 6 on  tne  CMU  POP- 10. 

Tne  mot  vation  for  the  two  investigations  is  abundant.  The  need  is  best 
expressed  by  the  following  **o  statements: 

"There  is  little  e dence  to  gu’de  our  thinking 
on  how  these  integral, ons  and  construct  ons  take  place. 

In  fact,  , nttie  attent  on  has  been  paid  to  how 

such  processes  occur  at  all"  (Haber  and  Hersh#nson,  1973,  pi 74) 

"Wnat  we  need  is  a set  of  operations  for 
defining  and  study  ng  the  kind  of  visual  storage 
that  will  build  up  the  structures  Of  perc«ved  forms 
out  of  momentary  glimpses"  (Hochberg,  1968,  p322). 

As  for  the  goal  of  specifying  the  results  in  the  form  of  a computer -implemented 
model,  I believe  that  one  major  factor  wh»ch  has  contributed  to  the  fluid  state  of 
affairs  at  the  theoretic  J level  »s  the  failure  to  attempt  complete  specifications  and 
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implementations  ot  the  imagery  ano  perceptual  process#*  implied  by  a stated  theory. 
Accepting  the  view  that  perception  ana  rnagery  art  Basically  symbolic,  information 
processing  activities,  the  computer  and  several  emsting  programming  language  systems 
(IC  ^ISP)  now  provide  a valuable  means  for  the  further  investigation  of  theoretical 
proposals.  Not  only  can  some  gnt  be  shed  on  the  sufficiency  questions  for  any 
proposal,  but  through  implementation  design  and  subsequent  actual  system  behavior, 
other  theory  implications  possibly  not  reaped  earlier  appear  for  consideration.  What 
control  information  is  necessary  ana  can  it  be  feasibly  included’  Is  the  information 
representation  concse  enough  to  fit  into  a limited  STM  (active  memory),  yet  rich 
enough  to  afford  tht  merences  which  subjects  d-splay’  These  are  only  two  of  the 
many  questions  whic*-  annol  real  y be  answered  for  a perceptual  (cognitive)  theory 
until  a completely  opera'  onai  specification  and  Implementation  has  bean  realized,  or  at 
least  attempted,  for  a reasonable  subset  of  activity  Evperimenlal  research  in 
psychology  has  provided  the  necessary  critical  mass  of  design  relevant  information  to 
attempt  an  initial  implementation  of  the  theory  such  as  VIPS. 

The  implementation  goal  here  has  been  more  estensive  (inclusive)  than  that  of 
achmv  ng  simple  input  output  equivalence  or  correspondence.  VIPS  employs  a number 
ot  memory  components  end  perceptual  processes  which  eeplrcitly  contain  all  ot  the 
symbolic  information  involved  m the  pf’ceptua!  system's  operetion.  The  memory 
components  end  their  associated  characteristics  have  been  interred  from  eeperimental 
resu  ts  of  cognitive  psychology  (icon,  STM,  ITM).  Thus,  the  model  attempts  to  realize 
correspondence  at  a less  superfic  al,  internal  level.  The  programmed  system's  output 
is  a trace  ot  memory  content'  at  selected  points  ot  processing.  A common  criticism  ot 
computer -implemented  models  (simulations)  of  human  cognitive  behavior  has  been  that 
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they  necessarily  cmp  Oy  many  h.dden,  tomoute* -or-ented,  non-psyf  .olog'Ci'  Opera, >ons 
to  a:n  eve  input-output  equ  . aence  Trs  and  other  recently  imo'emented  systems 
(Ne*  eli,  19^2;  Moran, * 9 i > attempt  to  mane  tneoretcu1  ' .■  cations  explicit  in  tne 
.mplementation  to  « greater  eatent  than  oetore  and  to  eap'Ore  (confront)  the 
consoq  icnces 
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4 'nes's  Content  Gude 

o accomplish  the  base  .nvest-ga*ory  goa,  tne  necessary  first  goal  of  the  thes-s 
was  to  develop  an  e«per'merta  s tuat.on  when  *0u‘3  , e a data  of  value  to  image  and 
perceptual  process  speoficat  on  Chapte'  12  provdes  a description  ot  the  two 
e*pcr  ments  carred  Out,  o‘  t^e  *orm  of  tne  da* a acquired,  and  ot  fne  analysis 
p'oceo se  which  inj  ?o  t^p  *esutfant  s?'*ei*  -pec  • cat-on 

Cnao**'  13  cesc' dps  Te  i^a^e  representat-on  *nich  has  bee''  proposed  A 
c?  s .j*  s an  of  tne  Das  i o*?s  gn  cr  te*  a at  red  is  *o  owed  by  a fu'l  e«D  a^at  on  of  tne 
resu  t "3  'mage  spec t at  on 

Chapter  14  -s  an  e«poston  ot  tne  p'oposed  pe'ceptua  processor  at  an  overvew 
eve  Con^tuen*  memo'-es  and  piocesses  and  the  r .nterre  at.on  n.ps  a'e  fully 
oescr<oed  Mucn  of  this  ie  e*  of  specification  will  be  seen  to  result  from  a oes  re  to 
•enam  cons  stent  with  eiternat,  re'evant  psycho'og  cal  fmd-ngs  and  theor.es,  especially 
concem.ng  tne  memory  proposa s Tne  speof-c  cperat-ona)  characte'-sf  cs  and 
contents  of  these  i-cno'es  and  processes  are  e rect  res.  ts  of  the  e*per  mentaiy 
acqu  red  protocol  data  Tn.s  cnapter  s f^e  Over  a i theoretical  statement  o*  tne  J^ess 
The  second  ha  f of  the  chapter  serves  to  illustrate  the  proposed  perceptual  system 
and  mage  representation  n act. on 

Ch -pier  15  d stusses  poss.be  e«tens  ons  to  tne  .mpemented  system  to  account 
for  tne  subject  Deha/ or  upon  !.r*e  draw  ng«  y.e  dmg  tnree  -d  mens  on  (pro,ect.Onai) 
perceptions  The  perceptua  theory  empoded  by  the  implemented  system  s then 
dscussed  an d shown  to  be  sat. sf actor  / genera'  /ab  e In  such  a genera'  form,  ,t  is 
shown  to  be  useful  >n  accounting  for  both  d.recty  acquired  ana  #*ternaiiy  noted  eye 
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movement  data  *n< j tne-r  assoc  ated  visual  perceptions  Accompan,  rg  proposas  a*e 
aso  made  to  rea»/e  t >e  e«tenson  and  generalisation  j*  the  full/  mstantated  -mage 
representation  tor  are  dra*  ngs  to  enguif  a v.sua-  en«r  comments  and  per  pnerai  v.sion 

COnsiOt  *t«ons 

Chapter  16,  as  tr-e  conclusion,  cor  .»*.t  tne  proposed  mage'/  system  af'd  !s 
representational  truct.res  to  otner  comparan.e  proposal  A Brief  dnscr.pt. on  ano 
d>SCuss<on  of  a genera.  Wo* t 0*  .ogn.ton,  rehear cn  Suggestons.  ana  an  ev4u$t<On  of 
tnes  s goa>  reaii/at-on  co»-  ,,oe  tr  report 

In  tne  second  *0'u^«c,  >apter  i»  . g es  compete  expositions  o*  fne  tnree 
supp  ementary  perceptua  p-ncesses  and  of  tre  t*o  .rr.pfmentea  ass."  lat’Qn 
accOmoaat.on  p'oc*-.'  nsta***  .t  pr*  *n,e*“  -a,e  Been  n«e"ed  from  tne  obla^ed  data 
Tr*e  chapter  references  ar,pen<j  ces  o-sp'a/ ng  !ne  actua  mpementa*'0n  fist-ngs  to 
as  ait  fuller  undersland-rg 

> Chapter  il  ?,  nena.  o-  o»  t»*e  full,  spe  » ed  anp  program  .mp'en-enVd 
pcrceptua  s , stem  s contrasted  *o  >ne  Ob*er/eo  subject's  act  t,  o*  four  seeefed 
pretdeo  s A Qja  ’afive  *•  a ,a»  on.  oasea  on  se/era’  re  e . ar>!  o i<n!  tat  -e  measures  is 
g e > ’ft*  cn<ip!**r  r».‘.  o'  aoper1re  conta  n ng  transcr  pt.pns  0*  Sub.nct 
e*  «t /»or  and  traces  o*  prof/a'  a t vt/  at  se/efa  -e  /e  s o*  spec  f-c  t, 
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Chapter  12  Enpenments  a^o  Analysis 

This  chapter  s a descrptcn  of  t*e  «■  per  mental  and  subsequent  analytical 
procedures  employed  n the  deve'Oprrent  o*  tne  perceptual  process  ng  system 

proposed  by  tn.s  thesn  Ire  first  paft  of  the  napte»  cons  de»s  the  e«per  men!  n 
!-*~s  of  suD,ects.  st  rru'i,  required  tas*s,  a^d  acqu-red  data  The  second  part 
dscusses  no*  th.s  o-rect  » ac^u  -ed  data  njs  oeen  processed  to  serve  as  a ras*s  tor 
the  proposed  system’s  design 

Experiments 

TieO  e»per  e-ents,  each  cons  sting  of  severa  pa'ts.  **r#  conducted  to  provide  the 
data  necessa*  v to  mvest  ga*e  *nase  aspects  of  v sua  perceptual  he  a or  of 

interest  *-t»  n !»•.*  sta'ed  goa  o*  tn  s tress  ’ e p'  ra',  des  gn  c'te*  a for  the 
e.pt*  ^ents  used  a»e  nut  , •*»»  y es  c*  tre  tr^s  s goas  As  f xpp»  "*er,t  i 

t ret  *am  a'  /ns  ?ha  «ut)  c ' + ' a ass  of  •'C  d’a*  ngs  *h.cn  a*e  u*.tfw  t^'hf.'Oc, * 

e ’0  0*  rg  ta*  »*•  as  st»^u  A r*  • «.  » at  on  s !~r"  f rea'ert  forces  t**e  sub  ect 

to  r f *•  a* e a Mmr  jn  o’  _ * • ’ a p t.,  e »• * U *ea  ,’v  a ijupete  perception  o* 
*"**  •’  nu  . s * he  s t e • ••  ‘ r o.e  a s"  a 3 o ng/ee  Sua  a"g  e h0  P aho^t  a no 
<Jr  a a - ng  r.  Q»d*.f  »o  V /p  * DP'cept  or*  I s tas*  . v Ms  oa»a  »ep-.ant  to 
delpnr.  nn^  jhP  co-  i-^i  t>  -» eans  a**d  capab  ‘ es  o»  t’*r  sub.ect's  re»reptua  system 

Tne  pr  r*.,  percept  a ta*»  c*  tre  ♦ »st  e»per  "'fr*t  s "r  esse*  i>  art.f-cai  Tne 


second  e»per.n-pot  p»o.d«*.  Ja*a  *»om  a r*'0»e  r>or*»a  v sv.a  perenrt  on  situation 


It 
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involves  the  tracking  ot  tne  subject's  eyf  movements  our  ■»  the  perception  c i line 
drawing  stimuli  These  second  result  are  tr*en  interpreted  m light  ot  the  integrative 
and  imagine!  operatons  interred  from  the  prior  resets  to  further  specify  a 
comprehens*  '«  theory 

SUBJECTS 

it  is  not  a goal  of  tr  is  'nests  to  investigate  tn#  developmental  aspects  of  acquiring 
tre  ability  to  effectively  perceive  straght  line  drawings  It  is  to  investigate  the  nature 
of  the  processes  and  memor.es  involved  *n  tne  developed,  effective  perception  of  sucn 
pictures.  Therefore,  perceptually  capable  subjects  were  desired  This  n not  to  deny 
that  picture  perception  is  a learned  activity.  This  has  been  fairly  well  suostant»ated 
by  ch.td  observation  and  e* per  fronts  introducing  p.etures  to  people  of  cultures  which 
do  rot  use  pictures  as  a spat-ai  representation  medium  (Miller,  1973)  l.*ew.se.  tne 
possible  nf.oence  o»  any  precedng  developmental  period  upon  the  mature  pcto'ial 
perception  process  *s  not  oen.ed 

The  desired  subjects  were  persons  laminar  with  tne  class  of  lin#  drawings  to  be 
presented  as  stimuli,  thus  in'erent.a'ly  insuring  th»-r  possession  of  a developed  system 
of  coord  nated  processes  and  memor.es  aopiicab'e  to  tre  perception  of  such  pictures 
The  chosen  subjects  possessed  the  desired  experience,  plus  the  characteristic  that 
they  were  unaware,  to  a great  e«’ent,  of  tr-e  current  research  techniques  and  results 
m the  field  Of  the  psychology  Of  percept  on 

four  subjects  were  used  The  tneory  to  be  deve  oped  he»e  >s  of  the  type  which 
has  been  called  a m.ni-theory  (Newell).  It  accounts  for  few  subjects  on  relatively  tew 
behavioral  performances  The  subjects  employed  were,  at  the  time,  all  students  of 
Car negt«- Mellon  University,  as  follows: 


/ 
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Subject  B (B  I • male  gr  aduale  student  in  computer  science, 

Subject  P (Paul)  - male  graduate  student  m industrial  administration; 

Subject  S (Steve)  - ma'e  graduate  student  in  computer  sconce; 

Subject  G (Gwen)  - tema>e  senior  undergraduate  in  grepbic  design. 

Throughout  the  experimental  performances  there  appeared  to  be  no  great 
difference  of  capability  between  sublets,  tnough  they  possessed  differing 
backgrounds  and  current  situations  One  exception  was  that  G showed  some  greater 
sens  tiv  ty  to  si*e  (length)  characteristics  in  her  perceptions,  possibly  an  influence  of 
her  graphic  design  study  <th,s  d.tference  has  been  only  noted  qualitative**,  from 
anecdotal  exper  mental  indications).  Other  sub,ed  differences,  not  in  perceptual 
capao'ht  es  but  in  strategies  employed,  will  be  d scussed  later  as  results. 

EXPERIMENT  | 

All  tour  subjects  competed  me  tnr*e  pa’ts  when  comprise  this  expe- ment 
Before  each  pa't  of  me  experiment  the  sub.ect  was  presented  with  a copy  of  the 
instructions  for  Inal  part  The  subject  read  this  aloud,  and  then  was  permitted  to 
stjdy  the  instructions  until  sure  of  understanding  them  These  instructions  were  ail 
the  information  g ven  concerning  each  experiment  part 

The  instruct. ons  tor  Part  I afe  given  m figure  II  1 Two  of  the  reasons  for 
inclusion  of  this  experiment  pa't  a>e  indicated  m the  last  paragraph  of  these 
instruct  ons  It  was  fe't  to  be  desirable  to  use  a minimum  of  verbal  descriptions  of  the 
p ctures  to  be  used,  and  as  can  be  seen  an  that  was  said  >s  Tine  drawing*  Figure  II 2 
presents  p.ctures  of  the  twelve  line  drawing  stimuli  used  m Pert  I.  From  this  pert,  the 
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Figur*  II  1 


I tm t nu  t ion 

You  will  \»w  « i i : d v • a cn  »«•  * nu  driwin.Ts,  You  ait-  t*> 

look  at  v dr»e.r  * i I 1 mi  . you  an  t ie  f ! ;ll  • «!.•  cr  in,' 

it.  You  art*  tU  t ! a - . i , »'>J  r.-  t r I,  "rf.tJy",  ulm't  will 

pr<r  $»i  to  rr  ».  *.  : . • ;r  . i t *•  r reopen : n ••our  t •.  o*  will  l>« 

nq«  r«J  • ' * r.  , . ‘allows: 

l.  rail  descri  e :h«  lru  drawing;  then-  i no  "mrrcv 
Jr  t : ipt  i on,  t'  ' h c pleteruss  :s  dosirmi 

J.  am.wi'r  anv  q u-st  i.*tb  I iv  ha.c  a'  jut  t c In..  draw  in.*., 
or  oar  d -script  ton 

J,  J raw  ii.w  lie  draw  in.  , a>  you  recall  it,  on  the  pad  in 
trout  ot  >oa 

Do  not  star:  to  .ribe  t e*  line  drawing  unfil  alter  it  has  been  re* 
novt'i.  Do  not  start  Jmm  ^ the  line  drawing  until  alter  *ou  >ave  tv.pKtiJ 
the  mil  d su  ption  a id  an  *cicd  any  questii  is  I ask. 

I*i  i i a training  period  to  f*r.i  l ia”i*e  \ou  with  l ,e  class  oi  line 
draw  in  u»ed  tl  rou  an  liter  iv.per  Lr.ent  ■ ami  also  to  acquaint  you  with  the- 
ta sis  o'.  Jc  triin  * dr ai  i i roi  nenor/. 


\{ 
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subjects  that  only  st'a-ght  lines  are  employed,  and  tnat  several  different  types 

of  these  straight  line  drawings  may  be  expected,  !he>e  be  r>g 

l 1 ) simple  two  dimenvonai,  geometric  ob,ects,  win  or  without 

Overlay  (figure  II  ? (if  >i 

(?)  straight  forward  three  d mansion*;  p»o, echoes  (>  e 
Figure  II  2 (it)  ), 

(3)  impossib'e  three-dimensional  pro,ect'On$  (ie  Figure  U ? (m)  h 

(4)  transparent  (reversible)  th»ee-amensiOn*l  project-ons 
(i.e.  Figure  11.2  (iv)  ). 

As  noted,  the  subjects  also  practiced  de<cnbng  the>r  perceptions  and 
subsequently  drawing  them  from  their  constructed  memory  representation.  This  part 
of  the  e*per  ment  also  had  a hidden  subject  screening  purpose  if  fhe  subjects  were 
incapable  of  drawing  or  describing  from  memory,  or  if  their  perceptions  were  of  the 
fret  association  type  (i.e  "ioo*s  like  my  aunt’s  house"),  then  they  could  be  eliminated. 
However,  all  of  the  initial  four  subjects  were  sufficiently  successful. 

The  verbal  descriptions  given  were  recorded  on  audio  tape,  and  the  accompanying 
drawing  sequences  were  reco*d«d  on  video  tape  to  De  used  as  date  et  will  be 
discussed  m the  analysis  section  to  follow. 

The  instructions  to  Pert  II  of  Experiment  I are  given  m Figure  11.9  j end  en  example 
of  the  stimuli  employed  is  given  in  Figure  114.  This  part  was  conducted  in  anticipation 
of  Part  flL  From  soverai  pre-experimentel  trials  of  Part  III,  it  was  found  that  a 
vocabulary  problem  could  exist,  resulting  in  the  use  of  hand  waving  to  describe 
intermediate  Object  constructs.  This  pert  was  thus  primarily  a screening  part  in 
purpose,  though  the  verbal  results  obtained  and  recorded  on  audio  tape  were 


UCFKK 

VI 


Instructions 

You  will  now  be  presented  wit 
should  cons  der  each  to  he  a small 
to  one  of  chose  seen  in  the  previc 
looking  at  such  a drawing  through 
view  of  the  drawing  at  any  tine, 
do  as  follows: 

1.  describe  what  the  partial 

2.  give  any  Ideas  you  have  a 
given  partial  picture  cou 

I will  do  one  example  for  clariflc 


considered  to  bo  valuable  date  as  discussed  later. 
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PART  II 


Instructions 

You  will  now  be  presented  with  a series  of  partial  line  drawings.  You 
should  consider  each  to  he  a smal.  part  of  a larger  line  drawing  similar 
to  one  of  those  seen  in  the  previous  part  of  the  experiment  as  li  one  were 
looking  at  such  a drawing  through  a tube  which  allowed  only  j small,  partial 
view  of  the  drawing  at  any  tine.  While  viewing  the  picture  you  are  to  orally 
do  as  follows ; 

1.  describe  what  the  partial  picture  is  itself 

2.  give  any  ideas  you  have  about  the  whole,  of  which  the 
given  partial  picture  could  be  part 

I will  do  one  example  for  clarification. 


Figure  U.4 
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fhe  instructions  to  Part  Hi  are  given  m Figure  Jib  Tf*-  experimental  procedure 
and  task  of  Part  Iii  is  an  extension  of  a method  noted  by  Mochberg  ( 1 9t>8)  In  those 
preliminary  studies,  subjects  were  presented  w in  sequences  of  part  a!  views  enclosed 
within  a circle  representative  ot  the  v.ew'rg  ho-w.  The  experimenter  remained  in 
control  Of  the  succession  ana  presentation  ' n-.e  of  tne  discrete,  partial  views.  In  Part 
HI  here  the  subject  has  compete  cont'c  o.er  tne  hoe  positioning  including  the  d-rect 
movement  of  the  hoe  In  me  Mocnoerg  tas»s,  sequences  of  partial  views  are 
presented  Without  drect  movement  contro  or  occurrence  Mo  emovement  n those 
cases  rad  to  oe  totally  inferred  or  was  imp  ed  ny  a-redonai  arrows  interspersed 
between  views. 

Part  111  then  is  the  significant  part  of  tr  s experiment  Tne  beha-  or  obtaned  here 
is  to  be  modelled  and  expianed  by  tne  program  imp.emented  perceptual  system  The 
"think  out  Oud"  /erbaii/at-ons  Obtained  here  a#e  not  mt'ospect-ve  accounts  by  the 

subj*?ct  concern  nu  his  r.pna  jr  iey  are  pr  r.  „f  y «,ho*:  erha  cues  ndeative  0*  ns 

nte»na  process.ng  status 

>,e  pictures  e*"POyed  «n  !•  s part  were  s "•  a*  -n  type"  to  those  of  Part  I f«o 
p ctire  from  Part  l was  employed  r g se  II  6 pre  , p r»ur«y.  of  e ne  draw  rp 
st  m,  used  m Part  ill  Ti  e f oe  m,o^e*»ert  and  erba  /a*  on  protoco,  verba' 
descr  ption,  and  draw  m 'eq.ene  were  a recorded  On  v.deo  tape  I ♦ound  t 
unni  re  .at,  to  v r|ue  .tio*'*.  o*  t’'p  'objects  concrr^.r,^  tr.p,r  aesc»  ptions,  as  I also 

twirl  *Ound  m Part  I 

-Vi  the  subjects  were  tapaue  ot  t»ss  1a-»  l«ow  er  a suf>,c  t*  ♦oi*nc|  t to  t>e  a 
demanding  las*  and  a so  a t r ng  one  o-e  trey  0»t»  (an  quaiitat  eiy  note  a 


t 


to 


d. 


degradation  m performance  and  weakness  of  vo*te  d'i»-ng  be  last  protocols  0*  each 
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1 1>  tl  :■>  t ton 

he lore  vou  i a taidboarJ  anJ  paper  u Id,  which  will  easily  • ow 
a oat  t ta  *.  to,-.  i t ii.-v, 

n»i  hi  eld  will  p la  * J o . t : a i i . • (Ji.«ui  a un  sr  :lir  in  t pc 

to  one  t-1  t t tt.  n art  . 'he  hieiU  w i allow  illy  a ill  part 

'I  th  drju.tit,  to  i .»•  i ! : l holt  .n  the  cur Jt-oat  d. 

10  an  to  » e tin  I , o li'  uM,  about  t . drawing  until  you 

?«■»’.  • a--  - it-  t Jf  ir  . , r e if  plf’o  draw;  m a lashiou  . liar  to  t at 
<J  I u i . 1 1 t 1 • 1 op  t . 1 1 a :J  • I - -tall;,  tit 

d script  o i loj  , u ,.u  • . 1 t J 'ii.f,  a. 

ur  ■>'  t h ;>  if  a o',  rt  ill  .i  - all  i to  ; u •'  m I’att  , 
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sub.ect  These  natations  are  *n  w.th  tne  design  goal  that  the  task  given  force 
the  *.  ib  ect  to  extensively  utilize  h.s  perceptual  ability  and  memories. 

EXPERIMENT  II 

This  exper-ment  was  conducted  about  one  month  after  Experiment  l,  employing  two 
of  the  prevou,  sub  ects  <P  a-a  ’ns  e»per  ment  was  conducted  upon  eye 

mo/ement  tracing  eqj  pment  cessed  ‘"d  constructed  by  John  3ou>d  [Gou'd  and 
S*haM(K,  1965).  It  mixes  i te  ev<$*on  camera  input  image  of  the  presented  v.sua; 
st  mu  ' (line  d'awmg)  with  a camera  mpjt  of  a beam  of  light  reflected  off  the  cornea 
(ens  of  tr*e  subject’s  left  eye.  This  mixing  produces  a video  tape  p.  ntocoi  of  a light 
spot  mov  ng  about  t e presented  visual  scene  Due  to  the  bulging  of  th*  va  the 
lens  reg'On,  and  tne  geometnca  op?  cs  of  refiect'On,  this  light  spot,  wnlhm  an  error  of 
3 degrees,  approximates  the  current  eye  fixation  point  upon  the  presented  line 

drawing 

This  experiment  had  two  parts,  the  instructions  to  Part  I Pe  ng  given  in  F gjre  II  7 
Figcre  (1.8  presents  pictures  o'  tne  stimuli  used  n th.s  par*  Each  picture  was  flashed 
for  approximately  one-qja'te'  to  one*trvrd  second,  th.s  time  be  ng  that  found  to  be 
the  besic  (average)  fixation  t me  of  tne  eye  during  tre  scann.ng  of  a presented  vsua‘ 
r.t  muti  (reference) 

TKe  er&ai  description  given  &/  '*?  sjb.ect  wa<  r~  : Jc J a *d,  together  with  the 
d * a .%  i ng  don#,  was  Kept  as  mpo'tant  da'a,  as  d-scussod  later  Th#  *■  **  ~j. ament 
v deo  tape  record  was  a'so  Kept,  to  be  u?  ?ed  as  a chec*  to  insure  only  a single 
fixat  on  dur  ng  the  drawing  presentation 

The  instructions  for  Part  II  are  g ven  in  Figu'e  119  figure  1110  presents  pictures 
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:h.i 

-.<•  . ; -i  i; 

J'A  K ! 1 

til  p*rt,  a ad  art  1 to  tol  , v ll  :>e  ondiated  on  t • * so/*-.  i nt 

• ra  k in<  apputat  , 

1 ns*  r u».  i i on  - 

li  this  part  sou  w.ll  ••  presented  witi  a »-ru>  ol  t .li  r i tar  in 
c.pt  to  those  pie  sent  e-J  ? oarl.ct  hi  i’ient  itlori*  t *„ti  1 n >j 

draw  pr«  int  e*l,  j ill  . rv  u i 1 1 > drawn  upon  i it  . r.-t  n in  1 1 . it  ! 

•i.  « 'tie  i‘  pon  the  hit  p!ar  , ,im  are  t 1-4  a * -.it  t • n i-r  otti  -n 

point  ot  tm-  iross.  I will  : u uke  .»  t l na  t » t i ! | . r t'-»*  e 

traietnif  li  ur.  hen*  w , U*  you  tonti  c i.i  l i vi\  r * inter  i'.mou, 

thi*  lme  diavin*  stimulus  will  present.  i up  t*»i  screen.  ou  art*  to  e»»nMant  l > 

lisa*.  trie  ir.iss  i»ii-r  option  throughout  the  piffturi  nn-M'iu  it  mi,  Vu-r  mo*;* 

our  i os,  i-  evt  tra,  f in  • .le  u «•  w 1 ! not*  a -ove*  sent  , thus  invalidating 

t ia*  trial. 

A »onn  as  t • i p ture  is  rt*no  ed  sou  an-  to  ►?«- 1 ot  1 lie  hite  plate 
and  de4cnh«  arfellv  what  ou  recall  j out  the  pie  ented  driving,  while  sketch- 
ing those  parts  that  ou  i .u», 

Uch  picture  will  **e  presented  >r  a ri  e- 1 inter  al,  lines  will  irv. 
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EXPERIMENT  II  TifUf#  Il  f 

pak:  u 

Instruct  ion s 

You  will  now  l»e  presented  with  a series  of  partial  line  drawings.  You 
should  consider  each  to  he  a small  p.irt  ol  a larger  line  drawing  similar 
to  one  of  those  seen  in  the  previous  part  of  the  expel  irnent , as  it  one  were 
looking  at  such  a drawing  through  a tube  which  allowed  only  a small,  partial 
view  of  the  drawing  at  anv  tine.  While  viewing  the  picture  you  are  to  orally 
do  as  tol lows 

1.  describe  what  the  p.ircla  picture  is  itself 
«!.  give  any  ideas  you  ha  *e  about  the  whole,  ot  which  the 
given  partial  picture  could  be  part 
l will  do  one  example  for  clarification. 
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Ot  thO'e  *mt»  <)'.«*  >ng  * r>  ‘.rd  Vie  that  vr  er  a Of  these  art'  rep  a1'.  ‘fCr>  Par!  I 
0»  t1'**  r»'0f  me*!  I ht*  £ pri  (j,  r pi  on  0»  fn#  preserved  p.^tore  stih  * a* 

audio  tappet  any  !r,e  'PSu.Vn^;  *js  *ep!  Tne  re*r»  .extent  v d(  o tape 

protoco  **■  *ept.  a so  There  were  len  pieties  p'esented  in  tht*  pa»t  to  each 

suoect 

S T iMvA- i ChAWACTE'Ji  'ICS 

A note  '."Ou  d oe  rrace  nP,e  concern  ing  si  m cnAractP,,^tlC%  for  both 

»*  ■ pc r nnpnt  and  a",i  * e ,o  ea^ert  precis  Cf  tHese  cha'actcr  st  C •»  ^pon  tr>e 
A'A  .V$  proved  '0  a^j  * '»•  proposed  ne^or/  The  t*0  rriportant  st>rhul» 

c * a»  u !e»  « * . *o  re  d-scu*  -r  «'e 

, the  o. era  ■•'e  on*  ^ v:e 

2 the  ~e  O'  pnta*  O'"',  * !n  n the  ngs 

A o'  *•  r*  r>,«  -f,,*  «y  H^’pd  a*.  .*  " j r*e d cO**P*»'*t>e  a'***'  * !n  r>  ?nt* 

t • ts  jai  *ed  At  >»>  •«  ’a^ces  p»erer-'nd,  * **  dra*  'y/.  * noth 

♦» . pt ' n e»'*-  pe^r-  J * A»*r-‘ , ♦ e*  tn»»r  • .*  tfp?/ees  o*  -a  .»rbt*  tieturo"  t’p' 

pO"!s  ’ns  n-  r ^ | *t-p  "r  ? I'  i an0  j*.p'  • l-’3  0*  P/8  "'0  e"*!"'!. 

n : *pe'  "’P"'  ' Tne  • •f  er'i  • d-^la',r»>«,  on'a  n^d  •'e  'erv*e»*t  e**("*n«  0»  H ■> 

p»r  ! p * *■  A i"“  A,  • • 0»*  " n r,c  nr]',,  ar-J  ’huS  0*  C O^-pa' at)'*  engths  I»' 

‘;a»!  I , O'  t •{’♦*'  »'«*n*  I.  on.  . r*  P'V.  f f>  j cl  te  **(•'  «■ r , D"P  ' - e thOy.n  t "t* 

t'O  e a < r • j-a'‘.n..-j  „p{  *rj.  •»„•#.  r j o'  * ,.i  a p e n 1 a^V'I 

Ilf*  '}'!•».,  ot  *.«  *’.••1  .;■•  'ta  data  **d  '•  '"a'  t*  r 0Ml.  • !••»'  , * ('d 

;>  f re  >v  rP  !'*«•  1 n tr-e  r it  « •«,  use  0*  a constant  at  cO  te  pos  ? ona*  »e*erenie 

’’fti'p,  as  had  tienn  p * . j .«>  i ,nfj«  c>n  Jhp  ( pr ' i ''!•  1 l.nj*  *.ef.n  er>t  \ **»nj»tti  an<1 
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t*«»i f regularity  n ergth  *■  so  en*c  ea  t r.e  suoects  to  tmpio/  * constant  absotut# 
a stance  reference  set  a'so  Botn  of  tnese  absolute  referance  frames  have  a 
r a'  ac  ffrist  C "f  y"  correspondence  to  regions  or  neighborhoods  of  pictorial 
positions  and  lengths  (distances)  (Th<s  w<H  be  further  discussed  and  clarified  in 
Chapter  HI  ) 

The  second  <mpo'tani  stimulus  char acter.stc  s that  only  lour  basic  l*n# 
orientat  ons  were  ut -i- *ea.  t^ese  be  .erica,  hor-aonta . upper-left  to  lower-right 
d agona  , ana  to*e-  'eft  »o  upper  r.g-t  a ago^ai  Wth  fee  e*cept  ons,  no  lin#  drawing 
conta  ned  teo  O'  mo'e  d ago^as  of  t"e  s«  e case  or-entat-on  w tn  differing  slopes 
Tre  re^esant  experiment*  oafa  inp  cafes  that  tn«s  st  mu‘us  cnaracterstic  ltd  the 
subjects  to  classify  (perce  ve?.  ana  subsequent.*  ren-emoer,  line  orientations  m terms 
o»  just  tnese  fOu  basic  onentat.ons,  yie.d.ng  e-gnt  postbie  line  trave's.ng  d«rect*Ons 
(up  yP,  dO*n  (X).  let?  ii,  r gnt  - 3T,  down  left  - 0l,  up-'ett  - Ul,  down  r.ghf 
JP,  p ' f/t  l»P 

r»*e  except  ons  'See  r;u'es  . . .♦''0  c p»o.  -oe  a^ecdota  e.aence  .n  fa^or 

of  ?*'*'.*  infer reo  drect-o'’  c^ioj^gs  ve  Sjoc  s eni ourte^ed.  and  ve'oa-i*  noted, 
some  pro^e  ng  a°  •»  due  *0  *re  < e«  fence  o»  fne  d*Me»ent  soped,  same- 

ci-»etted  J<a~on««  *.|m  ^ • -g  e presented  peture  A. so  subjects  ne*er 

r*  e r* f o-ed  e»oa  . an,  *eg»ee  • s ope  *0'  !He  nfs,  norma 'v  us-ng  one  of  the  eight 
p'OCOsed  d 'e  tO"i  n-r  >erDa  , ng*  f>g  rro.en-ent  o rect  on  n protocol 

l*'t  e /a*  ons  O'  ’'r  0»  «•"•**  O'*  * fn.n  aesC'  pt  on 

P»e.  Ous  'e'Pi'f  ’a*  s'  ca  reseat*  n*s  sr,v  tnat  s ope  udgments  are  not 
a s’'  n tea  u"  *0'~  ..  but  V"3  'o  c uste'  aoout  se.e'a  common  reference  v entatons 
( r t*f r *enr*«s  «epms  to  no-cate  that  nt,»  a"s  n normal  vsua'  perception  situations 
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do  remember  directions  m terms  of  a relatively  smjil,  t mte  set  of  va'ues  (though,  m 
more  general  environments,  poss-oly  more  than  tne  eight  proposed)  This  clustering  of 
human  orientation  perceptions  has  been  similarly  noted  as  partial  justification  for  the 
representation  of  a boc*  wor.d  with  shadows  in  terms  of  the  same  cght  bas  c 
directions  Malta,  1972)  Wa-ta  does  not  clam  a psychological  model  otherwise 

2 Analysis 

DATA  TRANSCRIPTION 

Tne  data,  which  was  acquired  from  !ne  e»per.ments  discussed  above,  consists  of 
aud  o tapes  of  verte*,  part*  picture,  anp  comp  etep>ctjre  verbal  descriptions,  video 
tapes,  wh.cn  mc*uded  simultaneous  aud'O  recordmg  of  verbalizations,  of  the  subjects* 
performances  of  the  hoe  movng  tas*.  video  tapes  of  subjects*  draw  ng  sequences  of 
reca’ed  ‘me  drawings,  videotapes  of  eye  movement  "-.ann.ng  sequences,  plus  actual 
nard  cop,  draw  ngs  produced  by  tne  sublets'  through  recall  of  presented  stimuli 
This  >s  rot  the  usual  statist.ee*  data  gathered  .n  many  psychological  e«per-ments  Thus, 
how  tn  s data  » as  been  used  !r  generate  tne  proposed  visual  perception  theory  and 
the  P'0gram-i*vp  emented  vis^a1  informat-on  process  ng  system  rfQj.res  enpianat'On. 

Tne  audo  and  video  tape  recora^gs  were  first  transcribed  into  suitable  forms 
for  ana-ysis  These  written  or  graphic  transcrpt.ons  became  the  data  actually 
considered  as  the  bases  4or  system  spec  bcation 

The  data  of  t ■percent  I,  Par:  1,  was  aud'O  recordings  of  compete  me  draw  ng 
descriptions  and  video  recordings  o<  the  drawing  activity  of  subjects  reproducing  the 
line  drawings  The  transcribed  ’Orm  o<  this  data  is  illustated  by  by  Figure  II.  I 1 The 
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audio  data  >t  transcribed  in  a straight-forward  manner  Each  hesitation  in  sc  -rrch  is 
noted  by  the  commencement  of  a new  line  of  transcription.  Any  significant  pause 
(over  2 sec.)  is  noted  by  a ‘(pause)*  VTIME  is  the  approximate  viewing  tme  in 
seconds  for  that  subject  on  that  picture. 

The  actuel,  hard  copy  I ne  drawing  reproduction  enecuted  by  the  subject  server  as  a 
framework  for  the  transcr  pt  on  of  the  draw-ng  Behavior.  Numners  and  arrows  were 
appropriately  added  to  indicate  the  order  and  direction  of  the  drawing  strokes 
observed.  Various  features  of  this  data  contributed  to  tne  specification  of  tfe  image 
representation  of  VIPS.  The  v sual  concepts  and  interrelationships  between  *hem 
which  occurred  in  the  verbal  descriptions  were  most  mportant.  Interactions  between 
the  verbal  and  drawing  behaviors  were  others. 

Pert  II  of  Experiment  I was  primarily  of  a training  and  screening  nature.  The  data 
obtained  were  verbal  reports  based  upon  partial  (single  vertex)  picture  information. 
These  verbalizations  were  transcribed  in  a manner  analogous  to  that  ot  Part  I,  as 
illustrated  m Figure  11.12.  The  data  was  marginally  valuable  tor  both  image  and 
processor  proposals.  The  verbalizations  provided  indications  ot  subjects'  vertex 
dessificetions  and  the  perceptual  inferences  made  from  such  vertex  classes. 

The  date  of  Experiment  I,  Part  III,  was  m the  form  of  video-tepes  of  subject  ho>e- 
movmg  behavior,  which  included  accompanying  audio  recording  of  subject 
verbalizations.  Selected  protocols  have  been  transcribed  as  a series  ot  informational 
frames.  Two  such  frames  are  illustrated  in  Figure  IU3.  The  element  A (see  Figure 
ILI3)  is  the  ordinal  number  of  that  frame  in  the  Protocol,  in  the  form  Vi,  i an  integer. 
Element  B is  the  partial  view  which  the  subject  net  through  the  hole  at  that  pcmt  in 
tho  protocol,  the  circle  being  representative  Of  the  hole  opening.  Element  C is 
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me  udeo  o^v  when  the  subiect  is  at  a vartaa  of  th»  l.na  drawing.  It  indicates  which 
verten  >s  in  view  according  to  a numbering  system  defined  by  the  first  page  of  the 
tra-  cnption  (see  bottom  of  Figu’e  11 13 

The  recond  ie;d  of  a transcription  frame  may  be  empty  (as  in  VI)  or  may  have 
ements  D and  E as  specified  contents  0 is  an  arrow  representing  the  direction 
O'  the  hoie  movement  occurring  at  tha'  point  in  the  protocol,  i s the  symbolic  code 
used  m VIPS  to  represent  that  direction  When  no  movement  <s  occurring  this  field  is 
emp'y  The  third  field  is  used  for  the  transcription  of  verbahjatiOns  occurring  in 
conjunction  with  the  ho'e  position  and  movement  state  defined  by  the  first  fields 
Tnese  verbalizations  are  agan  transcribed  analogously  to  those  of  Part  I. 
Furthermore,  each  speech  segment  is  labelled  at  its  end  by  a statement  number  of  the 
form  ’[Si]’  ('  an  integer),  facilitating  its  reference  by  the  teat  The  compete  verbal 
descriptions  and  reproductive  drawings  obtained  were  transcribed  as  for  Part  1,  also 
Figure  II .14  presents  a sequence  of  nine  protocol  frames  to  illustate  more  fully  the 
nature  of  the  transcription  and  behavior. 

The  data  from  Exper  men)  11,  Part  I,  were  audio  recordings  of  partial  picture 
descriptions  and  associa'ed  partial  drawings  These  resulted  from  the  short,  S'ngle 
fixation  presentation  of  line  drawing  stimuli.  The  verbalizations  were  transcribed  as 
usual,  and  the  hard  copy  drawings  paired  to  these.  See  Figure  IL19  tor  an  example  of 
the  transcribed  data. 

The  data  from  Pert  II  of  Experiment  II  consisted  of  video  tapes  of  eye  movement 
protocols,  audio  tapes  of  subsequent  verbal  description*  , end  drawn  reproduction*. 
The  eye  movement  sequences  have  been  transcribed  as  in  Figure  1116.  Element  A n 
the  sequential  fixation  number,  and  B is  the  fixation  duration  in  sixtieth*  of  a second 
The  initial  sequence  segment  is  connected  by  dotted  lines. 
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;pan$cp;pt;  v.  uOL 

Tne  verbal  aesr»  pt.ons  from  r-e*  yf  o*  compete  / pe * e .ea  d'a*  ngs  that 

* oota.nea  tn'Ovign  f«pe*» '^e^t  i.  pt'ts  I ana  III,  and  Experiment  Ut  Pa»t  i».  ser^ea 

A.  ^ .»>■  er,.e  ot  n»o*mat'On  tor  tre  o4  tne  image  memory  y-e  a ng  i-c^1 

;i*i  'pt-ons  * *v  !fpes  u4  tn.ngs  (concepts)  rememoered,  tne  rt».*tionsh,ps  used 

a en  remembered  p.ctu'e  • pe  t-cs  an<j  <o^  epts.  p ctufe  character  sties  not  noted. 
*np  '.pe',  o4  «-»fO".  ocfurr".  and  the  sequence  ot  tne  /rb^  aescr*pt  ons  wt'r  a 
used  as  ntpren  a B eat  on*,  o*  the  content  a" 3 struct j^e  ot  tne  underiy  ng  m^# 

'epresen’at.on 

50'reth*ng  must  DO  »A'0  COncern."g  ree.ancf  Ot  t*>f  vp'ha  .I*4.*  to  tn# 
pec  f eat  on  ot  tne  v<sua  mag*  a-'d  percept  on  system  The  protoco  verba"*tt  on* 
”i  ate  inte'na1  states  (goa1  . cont  »matons)  and  as  Such  do  to'm  a reasonao e bats 

* r process  rui€  spec •< tC at>on  Tnese  ve'ba:  .”t  or*s  a'e  not  ’Mrospe  t ve  ass*  ? 0"S  as 
to  tne  nature  and  course  o4  act.  t,  Tfe  . sua  mage  «nich  s constructed  by  the 
p..»'Ceptj.»’  act  vty  series  as  tne  secant. c oas  r tor  tre  subsequent  verDa  aeserphon 
A * uch,  the  verbal  closer  p?  on  indicates  inform*;  on  th*t  must  be  ronta  ^ed  n or 
re  »d  ty  'ji»r(  /fd  from  that  sja  .mage 

These  same  experiment  parts  a'so  provided  a correspond  ng  group  of  Ime 
drawings  performed  by  re.a  . p us  'i<?eo  tape  record  ngs  of  the  dra*ng  sequences 
Tne  dra*  ng  sequence  «tsed.  araamg  nes  tat  ons  and  fa  st  pen  pos  honings,  a d tne 
final  drawings  n terms  of  errors,  cons-stent  u'terat-ons,  and  correctness  til  war#  tgt>n 
considered  effective  bases  for  inference  concern.ng  the  information  »nd  structure  Of 
the  comp  ete  image  memory  represent  »t>on  of  lint  drawings 
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"'n#  De^UvO'  prctO'O'S  ODta  *93  *n  fip«r,men!  ;,  P#rt  lil  asO  pro  >Oed  nformaton 
reevant  to  the  .mage  ' epresenta’.on  oes  gn  r*t  chosen  representation  must  natura'ly 
facii'tate  rea>./af  on  o’  t *e  pf-  ep!  »'  n»erence*.  .mage  alterations,  ana  .npu! 
ntej/at  ons  *h  c*i  Occur  n r e OJSCr  ed  De^a*  or 

’re  D*-na  or  mode  ed  by  VIPS  tny  q«  fr>e  note  "'0.'nt:  pr< 'ocols  ♦'■om 
E ■ p£  r me»*t  , Part  lii  A r e ha-s  r bed  w.aeo  ‘ape  p»otoco  * er  ed  as  the 

pr.ma'y  ba  s tor  tne  .pc  * iC  tic4  n.T.on  a*>d  .mpyr citation  o‘  !*>«*  perceptual 
processes  o»  VipS  'he  impiemen’afon  reflects  t^e  ties  red  e«tenaaoiiit  / of  both  the 
proposed  processes  and  im#ge  'eD'ese^at  on  to  a more  genera  domain  of  visual 
scene  input  ana  »»*e  des »eJ  tore  at>on  'e«tengaD.*>ty>  to  the  normal  e,e  movement 
siK.at.on  t.nc  ua-nj  pe'  p^e'a  s.O"  CC^saa'a*  0~< 

A ot  tn«  protocos  or’*  ‘d  from  tne  e«per-ment  were  consicr'ed  at  a genera', 
qua  ta1  e,  anecoofa  eve!  f rst  Tn.s  a^a  yS.S  ga/e  rise  to  som#  general 
c ha»ac’cr  vtics  t*  tne  pe*rep*  a processing  sys’em,  p us  the  into,,raton  re'evant  to 
image  memory  design  as  oscus'eo  aoove  Trvs  overa.i  cons>der*;.on  was  instrumental 
•n  tre  proposa  ot  *our  component  processes  <see  Chapter  4)  Then  three  protocols 
*cr  each  subject  were  comp.ete-y  transcr  bed  ana  anay/eJ  m depth  to  further 
instantiate  t*e  constituent  pe*ceptua  processes  n te'ms  of  contrc  and  operations 
necessary  finally,  processes  wer*  mp.emqnted  to  account  specitcaiv  to»  to ur  of 
these  f igure  1117  .npicates  tre  degree  ot  ana.yt-c  rons-oerat'On  g'*en  to  each 
obta  ned  protocol 

The  protocol  data  was  co«s  dared  to  bt  two  mutually  interacting  groups  Of 
information  One  group  »s  the  hoe  movement  sequence  itself,  m terms  ot  location 
<v.ow),  movement,  anq  genera  speed  and  t-m#  factors  The  other  body  of  tnformation 


! 


I 

V 


?MCT  HL  ^nfMnMdCt. 


r 


Figure  II 17 

/ 

1 *? 

•J  -f 

B 

B 

B 

z 

■J  "» 

-<>>  i 
41  i 

» y & 

J t > 

r>  J o 

J*  4 

-+fc  -* 

i 1 

1 1 
1 f 

j >f 
*<•  * 

1 <? 
-t 

t % 

" Hr 

J t 

H H 

|| 

B 

B 

B 

z 

>r 

Z 

z 

Z 

z 

© 

z 

z 

z 

z 

11 

z 

z 

z 

z 

£> 

z 

z 

z 

z 

131 

V 

y 

y 

y 

y 

y 

y 

1 

eS 

\ 

z 

H 

H 

S’ 

i- 

B 

B 

H 

cO 

o 

a 

cJl 

36 


was  the  verbalizations  provided  al  various  occasions  by  the  subjects  during  the  hole  pottibl 

movement  task  performance  The  verbal  statements  ware  used  as  indications  Of  being  I 

currently  active  perceptual  goe  s,  realized  recognitions,  and  attended  image  memory  been  tl 

information.  The  hole-movement  sequences  were  analyzed  to  relate  movement  tub-  0t  j ,, 

sequences  to  these  inferred  strategic  perceptual  goals  Then  each  subsequence  was  duratio 

further  analyzed  to  infer  its  associated  underlying  control  tactics.  In  the  absence  Of  each  fi 

verbalization,  perceptual  goals  were  inversely  inferred  from  observed  movement  of  proi 

subsequences  with  control  tactics  which  had  eitewhere  been  related  to  a verbalized  Un 

|oel.  considi 

The  analysis  of  the  data  obtained  from  Enpenmenl  II  upon  the  eye-movement  inform 

tracking  device  was  mostly  earned  out  at  a qualitative  level  with  the  esception  of  a the  th 

quantitative  analysis  of  filiation  durations.  This  data  was  analyzed  m light  ot  the  sizes, 

perceptual  system  end  image  representation  developed  from  the  analysis  of  the  hole-  guides 

moving  protocols.  The  data  served  as  the  basis  for  the  a«te«sion  of  the  implemented  produi 

proposol,  also.  the  pi 

Part  I of  Esperiment  II  was  designed  to  yield  insight  into  the  amount,  content,  and  Thus, 

structure  ot  visual  information  entered  into  image  memory  from  one  initial  brief  simu'a 

fivation  upon  a presented  ting  drawing.  It  is  assumed  that  the  primary  informational  Simula 

difference  between  the  positioning  of  the  hole  and  the  positioning  of  the  eye  at  a proce 

picture  location  is  the  absence  of  peripheral  visual  information  in  the  hole  positioning  Tl 

case.  It  is  noted  that  a completely  different  motor  system  for  positioning  is  involved  in  (nd  a 

each  case.  These  are  taken  to  bo  functionally  equivalent.  thoor; 

The  eye  movement  sequence  protocols  obtained  from  Part  II  of  Caporiment  II  (two 
aub jecta)  were  in  studied  at  a general  level  to  note  any  reguieotiee  of  behavior 
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possibly  appearing.  E'gM  eye  movement  prptoco's  were  then  fully  transcribed,  these 
being  Upon  four  pictures  for  which  holo  rrbvament  protocols  by  thp  sir*  subjects  had 
been  thoroughly  trenscribed  end  analyzed.  Esch  sequence  is  trensribed  es  e sequence 
of  ImitiOns.  Eech  fuation  is  represent  d m terms  of  location  end  duration.  Fuetion 
duration  is  assumed  to  be  directly  related  to  the  amount  of  processing  occurring  at 
each  Illation.  The  sequence  of  filiation  locations  provide  indications  for  the  inference 
of  processing  strategies  and  states. 

Underlying  the  development  of  the  proposed  processing  model  was  a general 
consideration  and  an  Overall  amalgamation  of  as  much  ralevant  psychological 
infoimation  a*  possible.  Soma  of  those  results  aro  appropriately  referenced  throughout 
the  thesis.  Findings  concerning  short  term  and  long  term  memories,  their  a Instances, 
sizes,  overall  retrieval  structures,  -nd  operating  characteristics  were  used  as  design 
guides.  So  were  ideas  concerning  the  representation  of  cognitive  processes  in  e 
production  system  form  [Newell  and  Sunon,l  972 J Together  a*  of  this  otter nel  input  to 
the  proposal  furnished  a valuable  and  necessary  basis  for  overall  systom  character. 
Thus,  the  implemented  system  is  not  merely  a computer  program  which  accomplishes  a 
vmu'ation  of  a body  of  observed  human  behavior.  The  system  further  reptiles  this 
simulation  through  the  embodiment  end  utilization  of  the  functional  units  Of  the  human 
processor,  as  proposed  from  the  results  of  recent  research  Hi  cognitive  psychology  . 

This  chapter  has  provided  some  idee  of  what  observed  behavior,  trensribed  date, 
and  analysis  procedure  has  lad  to  the  proposed  imagery  and  perceptual  system  and 
theory.  The  following  chapters  ere  on  eipesitien  of  that  prspoail, 
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Chapter  13  The  Image  Representation 


This  chapter  is  an  e»pos<!on  of  the  symooiic  mjge  represer**t'On  used  m VIPS  to 
embody  visuai  infor  mat-on.  Criteria  which  served  to  deter  min#  the  form  o*  the 
representation  are  discussed.  This  is  followed  b>  a descript  on  of  the  epresentat'On 
fmaiiy,  low  Ine  image  representation  appears  m the  memories  of  the  cognitive 
(perceptual)  processor  is  br.etiy  Defined 

1.  Image  ^eprescntat  on  Cr  a 

Throughout  the  development  o»  tne  proposed  image  memory  representation  several 
gu.d  rg  design  criteria  were  app.ed  Possession  of  tnese  critical  characteristic  abilit.es 
by  the  proposal  were  deemed  to  be  necessary  tor  an  adequate  definition.  These 
necessary  properties  are: 

1 VEP3Al  DESCRIPTION  ADEQUACY  - The  ability  to  rea  >*e  representations 
wh.cn  not  o«iy  contain  the  information  necessary  to  yield  th#  complete  picture 
descriptions  obta-ned  as  data  m E>per  ments  I and  II,  out  a so  embody  this  information 
in  s/moouc  structiires  oear.ng  straght  forward  cof respondence  to  tnose  perceptual 
unit  (ie  oojects,  otner  cone  ts>  ana  re.ationships  used  n those  descr  pt.ons, 

2 DRAWING  BEhAvIOR  AOluoACy  - The  anility  to  realise  representations  which 
are  Soft  C tent  as  a source  of  (control)  information  for  the  las*  Of  draw  ng  from  memory, 
and  which  can  be  so  used  n a str*  ghMo'wa'd  manner  to  ye-d  tne  comp.ete  peture 
drawing  sequences  obta  ned  as  data  n the  experiments; 
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3 •"'CfCEPTuAi  ACTiv!’>  ADEQUACY  - Tn«  ability  to  realize  partial  picture 
representations  which  can,  n a straight-forward  wanner,  be  dynamically  (m  t me) 
augmented  (added  to)  or  altered  and  wh.ch  furthermore  can  serve  as  a source  of 
.r<ormat-on  for  object  recognition,  goal  determination  , and  hole  (eye)  movement 
contro  t*'Oughout  pe'ceptuai  cenav  or 

A SEMANTIC  Character  - The  ebil'ty  to  allow  for  the  coemttence  of  Ih# 
operationally  temporal  (sequential)  and  representational!/  spatial  characteristic*  of 
visua  imagery  (memory)  m a straight  forward  manner; 

5 IMERNAL  MOOAlITy  CHARACTER  The  ability  to  be  accessed  by  mean* 
bea»  r'g  stra  ght-forward  (isomorpn.c)  correspondence  to  that  used  to  access  evternal 
vivua'  inforr-  at  on, 

6.  EXTENDABIlITY  - Tne  <o  ty  to  be  extended  to  realize  representations  of  all 
visua  percept  ons  ot  form  m a st'a  gnt -forward  manner 

The  word  "stra'ght-tO'wa'dM  (me  phrase  "n  a sba-gM -forward  manner")  has  been 
cons  stent  y used  above  Tne  word  (pnrase)  is  to  be  understood  to  mean,  “with  no,  or 
a m n.mum  of,  add  t onal  process  ng“;  wn#ff  process  ng  cou‘d  be  derivation,  ceic  J etion 
or  rc-representat'On. 

Satisfaction  of  trese  dec  gn  c r ter  a nsures  a v-suai  image  representat-on  which  is 
consistent  wth  tne  mage  def.nit.on  of  Cnapter  J 1 The  first  three  criter  a correspond 
to  If  t*  mage's  detmironal  ability  to  serve  as  guide  for  vsually  related  behavior  The 
fourth  criteria  refects  t*e  necessary  semantic  character  of  the  visual  image's 
information  representation.  Sat  sfacton  of  th.s  requirement  insures  adequate 
noependence  ot  image  content  from  the  sequent  al  course  of  human  behavior,  yet 
allow*  the  image  to  be  a participating  factor  m that  behavior. 
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Th#  fifth  criteria  it  taken  directly  from  that  previous  image  definition  Thu 
requirement  represents  the  internal  modality  characteristic  ol  the  visual  mage.  It 
influences  both  representation  structure  and  tne  processes  which  access  this 
structure.  The  last  necessary  ability  is  the  result  ot  the  specific  nature  Ol  the  image 
representation  developed  here  It  is  limited  to  the  v.suat  environment  ol  straight  line 
drawings  The  utore,  the  proposal  dearly  must  be  readily  eatendable  to  be  ot  value. 

These  criteria  for  design  ot  tne  visual  image  representation  reflect  the  necessary 
and  functional  eaplanalory  adeouacy  required  Of  the  image  as  a part  ot  a scientific 
theory  of  perception  and  imagery  The  representation  must  be  a functional  component 
ol  a system  capable  ot  providing  mechanistic  eipianations  of  empirical  evidence.  VIPS 
employs  the  image  representation  m the  reproduction  (simulation)  ot  obtained  protocol 
(behavior)  sequences 

In  the  above  criteria  there  is  no  mention  ot  introspective  suggestion  or 
confirmation  as  being  a necessary  characteristic  ol  the  proposed  image  representation. 
No  aspect  need  be  suggested  or  confirmed  by  consideration  ot  conscious  eiperience. 
Pylyshyn  cautions  that: 

"What  IS  available  to  conscious  inspection  may  not  be 
what  plays  the  important  causal  ro'e  in  psychological 
process'  (Pylyshyn,  1973) 

Furthermore,  conscious  erpenence  is  not  a direct  reflection  of  the  content  of 
attended  memory.  It  is  rather  an  internal  phenomenon  created  by  the  application  of 
cognitive  processes  to  the  content  o'  attended  memory  The  internal  modality  criterion 
is  an  indirect  acknowledgement  ol  the  sensory  - like  nature  Of  the  conscious 
esperience  of  (visual)  imagery. 
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2.  The  Visual  Image  Representation 
SYMBOLIC  REPRESLNTATION 

The  visual  image  raprasantation  ol  VIPS  is  symbolic  in  nature.  A visual  ima|a  is  a 
structura  of  interrelated  symbols.  That  information  is  raprasantad  symbolically  by  tha 
human  is  not  a now  hypothesis  in  psychology,  as  indicated  by  tha  following  statement: 

"My  hypothesis  is  then  that  thought  models 
or  parallels  reality  --  that  its  essential 
feature  is  not  'the  mind1,  The  self*, 

'sense  data',  nor  propositions,  but 
symbolism*  (Craik,  1943,  p 57) 

The  hypothesis  that  a visual  image  consists  of  symbols  and  relations  implies  the 
primacy  of  the  abstract  in  perception  and  cognition.  Without  an  ousting  symbolic 
(abstract)  framework  for  representation,  there  is  only  end  always  the  everchanging 
flu*,  the  "blooming,  bulling  confusion*  of  William  James.  Cognition  knows  all  only  in 
terms  of  abstract  symbols  and  relations.  The  pr.macy  of  the  abstiacl  (symbolic)  is 
indicated  by  our  failure  to  find  a physical  measure  which  is  directly  related  to  any 
domain  o'  perceptual  qualities  (symbols)  and  by  the  relativity  of  ell  perceptual  qualities 
which  implicitly  makes  such  a finding  impossible. 

A computer  may  be  described  as  a symbol  processor.  As  such,  it  provides  a means 
for  testing  and  evaluating  the  symbolic  representation  hypothesis.  VIPS  investigates 
the  use  of  symbol  s representation  and  processing  as  an  erpienelion  for  visual  imagery 
and  perception.  Recont  research  has  shown  tho  efficacy  o'  symbolic  roprosentetion  in 
the  r iputer  - implemented  eapianetions  of  human  behavior  on  tasks  involving  visual 
information  (Boy lor,  1972;  Newell.  1972i  Moran,  1973).  Merer  presents  an  eitensivo 
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survey  o*  recent  proposa  s *or  me  fO'm  and  content  of  tne  symbolic  represents!  on  of 
visual  information 

IMAGE  CKAnS 


Tne  base  unit  of  suVl,  mean  ng*u,  r*age  mtorma*  on  *'thin  VIP$  <s  tne  chun* 
A visr*  mage  <r-  an  nterre  .*\»d  g*o  p (structure;  o*  i^e  chunk,  A chun*  'S  an 
nterre  «<  ed  group  of  symbolic  informal  on  e ements.  Access  to  one  e'em«?nt  of  a cnunk 
imp.  es  tne  mmed  ate  accevo  <ty  o*  a othe*  conta  nea  e events  and  fhe  nformat  on 
they  emoodv  There  *s  cons.deraD'e  experimental  evoence  *n.<n  .s  favor aoie  to  t**e 
proposal  Of  intormat.on  chun*'ng  m numan  memory  (M  er,  i9*)b,  fyeaell  and  $.mon, 
1972)  Tran-.cr -bed  data  trom  tne  thes.s  experiments  provide  direct'y  acquired, 
inferential  evidence  »or  t*e  rh u"»  ng  ot  >sua  '‘formabon  Tne  relevant  data  factor  is 
the  consistent  u«.e  by  the  subjects  of  a smalt  hn,te>  set  of  visual  concept  types  Each 
concept  type  has  an  associated  class  of  symbolic  information  structures  ehich  emoody 
tne  representative  spat  ai  conf.gurations  of  visual  features 

This  concept-based  chunk  "g  of  v-sua  information  influences  a<l  Of  the  Observed 
forms  Of  visually-related  benavior  Our  ng  perceptual  processing,  .t  influences  the 
determination  of  goals  and  eipectahons,  is  the  unit  of  visual  hypotheses,  and 
accordingly  affects  the  scanning  (eye  or  hole)  of  the  hne  drawing  stimulus  The  use  of 
visual  concepts  as  the  oasis  for  partitioning  (chunking)  the  representation  of  the  image 
information  is  most  directly  evident  by  their  use  <n  the  verbal  recall  descriptions  and 
protocol  verbalisations  I he  influence  extends  to  the  reproductive  drawing  behavior 
observed.  be*ng  a primary  factor  m determining  the  sequence  of  drawing  strokes  used 
by  the  subjects.  Bartlett  (1917*  reports  similar  resets  from  a recall  and  reproduction 
task. 
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The  'O'e  which  image  chunking  plays  in  the  perceptual  processing  is  discuSSuU  and 
ustrated  n Chaster  I 4 Appero  « A Concept  now  presents  three  groups  of  data  from 
Part  I of  E«pef  moot  1 Tne'p  ustrate  the  effect  which  information  chunking  within 
tne  .isuai  image  nas  upon  tne  observed  verba*  and  drawing  recall  behavior  The/  also 
ust'ate  the  use  of  visual  concepts  as  the  bass  for  nage  chunking.  Two  vi$uai 
concept  types  are  a so  introduced 

Group  i 1 introduces  tne  use  of  the  oo,ect  type  visual  concept  (OBJECT  Chun*). 
Both  sublets  use  t^e  “cross"  and  "triangle"  oo  ect  concepts  to  embody  the  visual 
nf or  mat  on  as  shown  by  tr*e  verba  oesc^phons  The  drawing  sequences  further 
ref.ect  the  use  of  these  v<sua  concepts  Sub^en^nces  of  draw  ng  strokes  correspond 
to  the  partitionings  of  tne  mage  chunks  Both  drawn  reproductions  contain  errors, 
however.  Tnis  nd*ca*es  t"e  nap,  »ty  A object  type  concepts  aione  to  represent  a 
p ct,  re  consisting  of  severa<  spatial  y interrelated  (interacting)  objects 

Group  I?  agam  illustrates  tne  uSt  of  the  object  type  mage  concept  furthermore, 
12  P and  12  S introduce  the  u.e  of  !h«  hne  type  v sua<  image  concept  (LINE  chunk) 
T'e*.e  th^ee  ewampes  of  Group  1.7  prjv  de  mo'e  e /pence  of  chunking’s  effect  upon 
tne  reproductive  draw  ng  oe^a  or  Each  verba!  description  reflects  a different 
conceptua  partitioning  of  thn  sua  information.  The  differences  ere  apparent  in  tne 
drawmg  bnhav  0".,  as  subsequences  of  strokes  show  correspondence  to  the  visual 
conr*  *>ts  of  the  re’afed  verba:  description. 

Group  13  lustrates  the  important  point  that  to  chunk  visual  information  according 
to  an  object  type  concept  does  not  necessarily  imply  the  naming  of  that  object. 
Neither  subject  has  a name  tor  the  object  type  image  concept  used  to  embody  the 
visual  information  appearing  on  either  side  of  the  center  rectangle.  The  primary 
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f t of  the  croice  Of  concept  type  used  to  chunk  any  vsuil  information  s to 
determine  Dis  c cha-ac’er  sties  of  t^e  s ic  st'uctu'e  which  s to  represent  that 
nfor-'at  on  Th  s opera  o~  >s  "O’e  fu-da^ent*  than  (no!  eqjiva  e^t  to)  verbally 
abe  ng  ram  ng  ‘hat  » sjal  ntormsVon 

Other  enper.menta  data  ♦‘d'Cate  tnree  ot^er  v>sua  concept  types  w*.cn  are  used 
as  chunk  types  n VIPS  to  create  tr-e  v $ua  mages  of  stra-gnt  -e  drawings.  The*e 
are  tne  veMe«,  s de,  and  ta.e  r con,unct  on  * t*  • ee-o  ~ens  ona  projeet-on  mages) 
type  vi$ua*  concepts  Thus,  t^e-e  a-e  f.ve  basic  'co-responjing)  mage  chunk  types 
used  m VIPS,  these  be  ng  VE  RTEX.  OBJECT,  „\\i,  SIDE,  and  FACE 

IMAGE  OnUNK  CHARACTERISTICS 

There  are  three  classes  of  elements  wmen  af.  »o  md  in  e.ery  mage  chunk  of 
VIPS-  There  is  one  Chunk  Header  eiement,  several  Image  Body  e’emerts,  and  one  or 
more  Position  elements  (see  F.gure  III.l)  Each  symbolic  element  «s  a group  of 
properties  which  interrelate  the  cements  themseives  and  *<50  re'ate  the  element  to 
the  appropriate  visually  meaning^  sympois 

rhe  Chunk  Header  element  serves  to  mp-cate  tne  type  of  vtsua'  concept  embod  ed 
by  the  image  chunk.  Thu  type  s indicated  by  the  va'ue  of  the  e ement’s  associated 
TYPE  property  (see  Figure  III.2).  Another  assoc  a‘ad  property  >s  CR  (Current 
Reference)  which  serves  to  reference  (afford  access  to)  one  Image  Body  element  of 
the  chunk**  image  structure.  Oeper  jmg  upon  th#  chunk  type,  other  properties  ere 
associated  with  the  Chunk  Header  element,  such  as  the  NAME  property  of  an  OBJECT 
type  chunk's  Chunk  Header  element  (set  Figure  UI.2) 

T-e  Wage  Body  elements  are  the  constituent  symbolic  elements  of  the  semantic 
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structure  embod-ed  by  the  nr, age  chun*  This  symbolic  structure  is  cried  the  ".mage 
b'-tl',  **  o'  an  r*iage  c»>li nm.  noted  above,  each  chun*  type  has  a characteristic  class 
of  ' age  Lcn,  structures  assooe.ea  * tn  t F .e  types  ot  image  Oody  elements  are 
usee  wtn  n V P$  to  'ea-  :c  these  a fter  ng  c asses  ot  information  structures  these 
t.oes  Are  x;T,  ANGlt,  ;\TE^\A  , £i\0,  and  QUICXSEE  Each  element  type  is 
a st  gjished  by  tne  prope'te  *mcr  m*,  oe  assoc-ated  eith  it  (see  Figure  1113) 
"ne'e  b'Ooert  es  aeterm  ^e  a c.  ent  ro  e for  each  element  type  wthm  the  mage 

DOCJ,  n*orrt-,a?  On  StrjCtu'e 

ta:n  t,pe  o'  image  3od,  element  has  both  manaatory  and  optiona  properties 
<i  o ateci  w tn  t The  mandatory  p'opertes  are  spec, t ed  tor  every  given  instance  of 
*hat  e ement  type  « th.n  an  in  age  body  The  opt-onai  propert.es  are  indicated  by  a 
■av  m F gure  1113  Wh.cn  further  opt  onji  properties  are  specified  for  a given 
element  nstanre  de  em.res  the  va  ue  of  that  instance’s  mandatory  Type  property 
*0'  e»ampe,  an  instance  of  a X,T  type  e'em.ent  may  na*e  TYPE  va  ue  ufcX  (unknown 
* t»  when  oni 1 the  mandatory  propert.es  are  spec  f.ea.  or  may  have  /a'ue  •< EX 

nno^n  FXt)  *Hnn  both  opt.ona  prcpe't  es  PVX  (Pange  Verte*  eX  t)  and  lVX  (link 
Vertex  eX  t>  are  spec  f ed  See  append  < A.L7M  for  the  expansion  of  the  mnemon.es 

Before  further  oescr  b«ng  the  symboi  c mage  structures  which  VIPS  creates  with 
t*  ese  a fterert  Image  Body  ee  merits,  tr  e act  c ass  o*  mage  chun*  e emerts,  the 
Po*.  hon  type  e'em-ent,  requ res  def  n hon  >.e  exper  menfa-  results  /.eld  anecdota 
e d »nce  tor  the  proposa1  that  the  positions  of  p :ture  (visua  ) feature*  are 
re»v<  mp« red  n te"'  s o4  ar  mp-i'C  '*'  ("f  j/^,“»  aosO'ute  locahonai  coord. nate  scale 
wn.  c . becomes  assoc>ated  with  tne  por*  on  of  the  visual  he'd  of  .nterest  (in  this  case, 
the  w'Ci.e  l«ne  draw  "g  st-mu.us)  Sub, efts  cor  stentty  use  generalized  positional 
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tcrm-  " ootn  tn.e  eroa>  cles'i  p?<on$  and  the  prctoco  e'Da'-zatiOns  Tne  ab"*!y  ot 
tne  r jr><ects  to  read  / n»po'res  ze  ne  eg"ient  n*ages  between  p cture  ert  ces 
D'Ov  ass  fu*theF  e de^ce  Varan  . ; 9 7 3 oe.ejped  an  rrage  rep'esentat  on 

whicn  aoe  not  nciuae  aoso!Lte  pof  ' O'-.*  -''o^a’  on  ne  naf.  subseq^enty  noted  an 
nne'en!  d**c,.t»  m ache.ng  $ n>  ’ Da*  a , aeterrr.ned  n^potnese*  A In  tha* 

r .p-.  p«*a?  0^ 


A • on  t-  e’  pn|  e-noG  J e e *f  .v."  Dcat-O"  ot  eacn  of  tne  in.a.-t*  3oa, 
e c^e"'  wn.cn  e * 0>  ♦.'?  P‘,_A«  ; cce*:,  A Poston  e^ent  as  two 

a'SO'  A*ed  b'OPerbes  "p  .e’t  n Povt gn>  ,iPC  IP  <U0  Co*n  Posit  on)  Lpp 
a~a  p eacn  ha  e »,e  en  po  ; e i.^oc  a ^e--  re  atr  cied  port. on  ot  he  v s .a1 

'M  s tnw*;  o»0*en  m«o  #0't/-n  ne  pas  ? 0*a  a*ea  a 0*"  r 'gu»e  Iii-1  Tne  SZe 
cons  tone,  o»  v re  o*,,*  ’g  * n<  eraoeJ  tne  constant  aoo  cat  on  ot  t*e 
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it  a basic  factor  in  tha  maintenance  ot  a stable  visual  world  n spite  of  the  varying 
retinal  ind-rations  which  occur  during  constructive  perception 

In  conjunction  with  this  seven-by -seven  reference  grid  ot  spatial  position  areas, 
VIPS  employs  siv  range  or  length  codes  Tnese  are,  m increasing  order  SH  (SHort), 
Me  (MEdiuml,  LO  (LOng),  IS  tvong  - Snort),  LM  (Long  - Medium),  or  LL  (Long  - Long). 
The  length  of  a line  segment  (or  ho'e  movement)  is  determined  according  to  the 
numoer  of  pos  I ona1  areas  traversed  Fo-  eiampie,  a line  segment  between  adjacent 
areas  >s  of  lengtn  $K,  while  one  from  a comer  a’ea  to  another  corner  area  is  of  length 
LL  (ve'y  'ong ). 

VER’EX  CMUN< 

Each  chung  type  ano  Is  associated  class  o'  image  body  structures  is  best 
understood  by  tne  dscuss  on  ot  a represental  ve  erample.  As  such,  an  example  of  a 
VERTEX  Chung  is  p-esenteo  m Figure  IIL6  As  shown  at  the  bottom  of  the  figure,  at 
one  leva  the  image  Chung  is  simply  a linear  list  ot  elements.  The  Chunk  Header 
element  (VI I occurs  first  n this  near  list,  facilitating  access  to  the  element  by  any 
attending  process  The  order  of  the  remaining  elements  at  this  linear  list  level  has  no 
meaningful  significance. 

The  mege  body  ot  a VERTEX  chunk  consists  of  an  equal  number  of  interrelated  XIT 
end  ANGLE  type  elements.  Each  XIT  element  represents  one  line  segment  exit 
direction  of  the  varies  (by  the  value  of  the  DVX  property).  In  Figure  IIL6,  X? 
represents  the  UP  exit.  Each  XIT  element  is  interrelated  with  two  ANGLE  elements  by 
the  values  of  its  associated  internal  vertex  direction  properties  DIV1  end  DIV2.  These 
properties  have  opposite  directional  values  which  are  perpendicular  to  the  value  of 
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DVX  In  Figure  1116,  DiVI  o'  *.?  »s  Pi  and  DiV?  of  » 
values  tnem  p es  become  popertes  0*  We  XiT  eemenf,  a ea<.h  references  an 
ANG„E  element  In  F.gu-t»  Ilib,  X2  has  D'opertes  PT  and  lE  * th  P7  referencing  A3 
ana  uE  referenc  ng  A5 

An  A\Gi.E  e ement  emooa  es  ?r>e  ,a-  teatwr  e .ang-e'  easting  tween  t*o 
ad.a' en»,  a^*e*en»  a fcrtea  e*  ! auctions  o‘  a \,er‘e*  Chapter  *2  has  w\i  .,i'eo  that 
the',*  are  e^ht  ci r t c .i  ues  is^.»o;st  sed  ■ * vlp$  Accord  ng  y,  the  ANG 
property  of  an  A*«GwL  • e r>-*?n!  A-  -j.e  o^e  o*  the  se  e*  poss  d p a»*g  v sv^bo  s a ds 
a u<>  Tnest*  a'  e ,mbO'  afe  ACA  acute  ang.e,  P'A  r ght  a^g  o,  JA-  obtu  e 
an-:'  *,  SrA  t'dght  tli.  vg'ce  ,r^  e,  $AA  strain*  acute  a"g  e,  SPA  traignt  r ght 
??0  degree  1 ang  e,  a 1 S A shagnt  obtuse  *r'r>  e 

An  A\G_t_  e c^e"t  na  t *0  ."terna  veUe*  a.-ectons  assoc  ated  a th  -t,  GIVI  and 
DIV2,  wh<cn  >»e  nnpnteo  ‘'or,  We  **o  XIT  eements‘  propertes  *h,Ch  reference  it 
Tn-s  <s  illustrated  n F z ,»e  III 6 GiVl  of  x?  s R"  a^d  P*  references  A3  DIVI  o*  *A 

’ and  .>P  rpfc'pr  e Af  A rord-ng,,  J!Vi  of  A3  UP  ana  UP  rotcfe-nes  X2  , 

V O*  A j P'  a' J * ' rt.*e,rn  , rfi  eve  S no  <■  gn,?cance  to  We  choce  o* 
""<*rt  o'  **>u  »Ao  r>* »» r r* 4 ..'*0.  (i  hens  To  317 i and  DiV?  Thc  con/t'il  on  for 

the  a" 'ftnme  ‘ o’We  "•••"a  er'c  'e  tons  of  an  At.Gi  E e'e^ent  tac  Tates 

"Wa-er  ar  of  We  image  boa  '*  !ure 

iVAGE  300V  ACCESS  "'*Av  PSA." 

To  access  We  symoo' c sf  *u»t»  0‘  an  mage  mage  body,  a process  must 

f • r r t ga.n  access  to  tne  image  as  a whO'p  ana  Wen  to  one  e'ement  of  We  image 

body  (the  mpans  for  this  are  o .cussed  in  Chapter  IG>  The  process  may  then  access 


/ 
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">e  contents  o*  the  ""age  nos*  structure  oy  sequentially  "havers  ng**  ,t  (from  the 
n ta  e’ement).  Image  body  .nements  are  accessed  by  traversal  of  ava*  able 
nte'reiatmg  properties  ' „•  mage  tody  elements  of  a chun*  are  immediately 
access  be  u^urn  or*  n t on)  put  not  acces  eo  n parallel  An  mage  body  element  is 
a>d  'o  te  "trj  er  .cu**  *^en  it  o accessed  n,  the  active  process 

IV  Jn  reference  to  the  VF**EX  chun*.  a process  may  traverse  the  structure  from 
one  <iT  e ement  to  a^otner  ty  us-r(>  *■  e same  nterre  at-ng  d'rectionai  property  t«*ce 
v F gjre  II! 6,  ST  o'  ‘2  s A 3 ano  PT  o*  A3  is  X4  or  equivalent'/  (RT  of  {RT  of  X?))  is 
*4  *»ofe  ! na‘  a VER’F\  c^nx  s co-p  e*e  y tra.e-safce  m t«o  sequent  a courses 
e *ner  X2  to  A3  *o  < i to  A5  to  *2  or  x2  to  Ab  to  X4  to  A3  to  X2/  As  such,  the 
sfrwc*ure  s a semant  ca  r aeto'^ned,  aouh  » n*pq  fdOubiy-drected)  circular  list. 

• n s ' , pe  of  st-^ctu'e  * t"e  ce  ca.  ea  a ao^b  >■  d reefed  r.rg  of  e'ements. 

ne  n age  00d*  rfr  t »e  of  the  VERTEX  cnun»  represents  the  v.sual  feature 
.onf  gu»at  0"  at  one  pat  a oca*  on  Tnus,  there  s on  , one  Pos  t, on  t,pe  cement  m 

* e VERTX  type  chu"*  Earn  mage  DOd,  e errent  references  that  t ement  by  its 

a'  area  °\v  V pr oper *y  <"Ot  nq*n  n f gure  A Pos  tion  element  tlffers  from 

a"  age  bon,  e emp"*  n t^a’  t s not  a ong  *.t n tne  Chunk  Header  e'ement)  a 
?ra  • ao  v e ement  of  mage  struct  j-e  of  the  chunx  A Posit-on  e ement  is 

r*j  rect  / access  be  ♦rom  any  'mage  oody  e ement  *h.ch  references  >t  oy  tne 
man  loatov  P’.wM  property 

0*3j£CT 

An  OBJEC  type  mage  chur*  s sc  hen- at  <c  a' iy  illustrated  by  Figure  HI.  7 . The 
image  body  of  an  OBjECT  cr.unx  .s  aga  n a doubly  - directed  r.ng  of  elements.  This 
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tune  the  elements  in  of  types  INTERNAL  end  ANGLE.  Tho  common  configuration  (non 
hierarchical  sub-structu'e)  ol  image  body  elements  which  it  utod  »t  tho  building 
block  of  tho  OBJECT  chunk's  imago  body  it  tha  "corr«i  ■ configuration.  Tho  lower  loft 
'corn#'*  of  tho  Fig'-ra  111.  7.,  >t  shown  <n  dota>l  by  Figaro  111  I.  Thu  configuration 
represents  an  object  corner,  but  a corner  it  not  on  explicit,  hierarchical  aub- 
component  of  the  OBJECT  chunk  mage  body  structure. 

The  comer  csnfigurat  on  a.ffert  significantly  from  the  image  body  Of  a VERTEX 
churn  deter  be 3 above  The  angle  e«'er  u to  the  oh  id's  corner  it  not  included  n 
the  comer's  representation  An  INTERNAL  element  hat  only  one  internal  direction 
properly  (OIVII  A process  traversing  the  OBJECT  chui  k s image  booy  structure  con 
not  -look  Outside  or  around  the  corner*  without  accessing  anther  imago  chunk.  Thit 
characteristic  of  the  image  representation  of  an  object  causes  a mode  Of  visual  image 
accessing  which  provides  a bats  for  the  experience  of  figure  - ground  phenomena 
(Kof  fka,  1935) 

Each  corner  configuration  reprj,  its  visual  features  at  one  spatial  location.  Thus, 
an  object  chunk  has  as  many  f t jn  elements  at  it  has  corner  coi  . gurations  m its 
image  body  structure  (see  Figure  HIT).  The  ANGLE  element  inherits  the  value  of  its 
internal  traversal  directions  (0IV1  and  0!V2>  from  the  INTERNAL  elements  of  a corner 
in  the  same  manner  as  from  the  XIT  elements  of  e VERTEX  chunk. 

Two  interrelated  INTERNAL  elements  span  the  spatial  separation  of  two  adjeconl 
object  'corners*  and  as  such  are  representative  of  an  object  'side*  (which  also  is  not 
an  explicit  image  component)  In  Figure  111.7,  M references  115  by  its  LIX  property. 
The  direction  (OH  of  It)  is  down  (00)  and  the  range  or  length  (RK  of  W)  it  long  U.O). 
Inversely,  IlS  references  It  by  its  LH  (Link  Internal  eXit'  property,  artth  OK  (Direction 
Infernal  eXit)  bemg  IP  and  RH  (Range  Internal  eXit)  being  L(X 


I 
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">e  somorph.c  re  at.onship  of  a process's  traversal  of  image  body  eemenls  !o  lb# 
operat  on  of  e«'er"a  v$ua  sca'-nfg  and  information  accessing  (enter. on  a5>  oecomes 
cear  w th  the  ntrodJCton  of  the  .rjjECT  enun*  The  contents  o*  an  object's  image 
'©presentation  are  accessed  by  tne  seouent.a  traversal  of  tne  image  body  elements  «n 
a manner  which  >s  semanhcai.y  equ>vaent  to  the  observed  hole  movement  behav.or 
T ne  image  represent,*’ on  and  ims  operahonal  re  ationsh.p  are  straight  lonaardly 
e«tendab'e  to  accemoaafe  norma  eye  mo.ement  behav.or  (Chapter  *5) 

furthermore,  tnis  tra.ersa  ot  the  >maje  body  structures  shows  a cose  befanorai 
re  at  onsh»p  to  the  (.etivity  n o .ed  m the  generation  of  drawn  reproductions  The 
npn -h'er arfh'C at  nature  of  eacn  mage  body  representation  and  the  spat  a>  mean  ng  of 
tne  nterrei  itiona  propert  es  of  the  e'ements  are  two  djs-c  representation 
character  st>*s  when  ma«e  poss  b'e  t > stra  gnt-for  ward  ap&  cat'On  ol  th  s 
oen*  ora’ly  somorph.c  travels*1  operat  on  for  .mage  access  ng  The  definit.on  of 
t/mhonc  e'ements  as  property  group  a'so  fac  tates  traversal  anc  S'gn.f.cantly  effects 
s / stem  operat  on  by  e!im.nat  ng  mean.ng  from  chun*  surface  structure  (order  of 
q e m e n t s ). 

LINE  CnuN< 

A _INE  type  ch  mu  ,*  illustrated  by  figure  111  9 It  is  agan  a doubly  d.ietted  ring 
of  mage  body  e nmpnts  a circu'ar  .sf  structure)  The  LINE  structure  a so  introduces 
tre  use  o‘  the  END  a^o  QuIC<$£E  types  of  Image  Body  e'ements  The  body  of  a LINE 
t,pe  chun*  includes  'wo  END  tvpe  e'ements  Each  END  element  references  an 
appropriate  POSITION  e ©ment  wh  ch  serves  to  spataHy  locate  that  ne  end  Each  END 
p.pmpnt  ras  an  associated  property  wh.ch  series  to  n*  that  line  end  to  the  visual 


( 
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con’*«f  embod  ed  in  another  irr,*ge  cnunn.  'he  TYPE  p'Operty’s  value  va'*es  with  that 
e^e'na  contei*. 

Each  E\D  ee^  ‘ has  two  internal  t*a.  "a  d reckons  assoc  ated  wth  it  (LSI  and 
"■0*  ng  traversal  o‘  each  "s  de"  of  trie  ne  Each  LlfwE  chunK  "side"  employs 
mte-re  a’ed  INFERNAL  type  e e^e^ts  to  span  spatia1  iocat<ons  as  m the  OBJECT  type 
chun*.  At  appropr  ate  locat'Ons,  verfe«-ii*e  conhgurat.ons  are  represented  by  either 
b/  nterre  ated  X!T  and  ANGlF  and  INTERNAL  eerents  (as  shown  m Figure  121.9  (a)  ) 
or  by  a snge  QUICKSEE  type  cement,  as  shown  .n  F g.jr®  HI. 9 (b).  A QUIOSEE 
e e^ent  only  part  ally  represents  t-ie  verfe<  mformat.on  e>$'t  ng  on  that  'me  "s-d e"  It 
on  / emood  es  tne  number  cf  vertex  e»its  i*av  ng  tre  me  at  that  location  (from  that 
side  A QjIC<SEE  e ement  does  reference  a position  e. ement  '-y  its  associated  PNwM 
bropert/.  Two  traversal  d rect  ons  are  also  assoc  ated  ttjl  and  TD2).  whicn  are 
nneriled  from  ts  neighbor  ng  INTERNAL  elements 

"he  QoIOSEE  e'ement  s ntroduced  to  represent  the  incomplete  nformation 
ara  'ed  b/  a subject  in  tne  ca*e  that  tne  hole  i$  moved  through  a vertei  on  a line 
w tnout  * tope  ng  This  inco"*p'etness  of  visua  feature  representa’  on  a'so  typ.hes 
per  pheral  .•  s on  input  informal  On  As  such,  a**  e*tens  on  (ger>er  a'lzahon)  of  the 
QUir<SEE  c ement  ,%  ater  proposed  as  a means  of  symbo'ica  y representing  such 
f.f-nphera  / accessed  visual  information  (Chapter  lb) 


IL  INF 


ht.  IlINE  enun* 
car’  a visua  mage 
C'C  »s  A r uh»c  of 


s an  Incomplete  LINE  type  chunK  which  mav  occur  as  pert  of  > 
e*  st  ng  at  some  ■'•e'med  a*e  po of  t^e  vsuil  percepf'On 
t’  s *,P»  re/er  li't  of  tre  f -a  zed  v sua-  image  (percep*  on) 
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which  s the  resu't  of  that  perceptual  activity  As  such,  it  s not  one  of  the  live  b»s<c 
chunk  types  as  sted  earlier,  but  »t  is  used  by  VIPS  tc  accomplish  perception. 

Figure  in  lOta)  presents  an  uStrat'On  Of  an  tt.  ♦.  * chunk.  This  chunk  type 
makes  a definite  specific  use  of  tne  CP  property  of  its  Chunk  Header  element  CP 
nd'cates  the  INTEPNAl  e ement  wncn  s to  be  mned  to  e>em#nts  representing  the 
•nm  nent  vitua  '•formation  dur  ng  ncorpO'at,on  into  and  the  completion  of  tre 
mjo»»  oody  (of  tre  me)  figure  lillO*b)  ates  tne  addition  of  further  mformat-on 
cO"n>iet.ng  tne  Ime  and  cha^g.rg  the  k.’.t  cn u"n  to  a 4. IN i cnun*  tote  that  the 
«.?  conf'gurat  on  s part  of  tne  resultant  Li'.t  t,pe  chunk 
""he  CP  propeMy  of  tne  Cnu'i»  reader  e,e^ent  is  s m , used  by  the  y.Sua 
Drrcept  on  p-OCe'S  n fre  onsfrull'On  0*  C8.1ECT  t,pe  Chunks  Incomplete  OBJECT 
chunks  are  not  made  nto  such  a spec  a -mage  type  teg  IOBjECT)  tnougn,  as  tne  ob,ect 
mcon-p  eteness  s a'ways  e^bodeo  a tn.n  t**  act  ve  pe'centuai  goal  An  1lI\E  chunk 
may  OCCU'  <n  COn  unc'  On  w t n goe-S  ikh.cn  do  rot  spec.f  Ca  y note  ts  e»  stence 

SIDE  CMUNrf 

A SIDE  t,pt*  ct  ur»  s eo  (occurs)  c*!,  n con  urct  on  » tn  an  associated  OBJECT 
o-  ACE  .*  n.  Tne  ♦e’ationst' d ustrateo  n tre  scher-atc  sketch  of  Figure  HI  II 
This  ■ re  ntroduces  a p.to'a  'epfe  e^tat  on  conve^t  un  Eacn  mage  ood, 
ec-o-t  s on*/  sp*»  ♦ #»o  o»  c«e  of  f .e  te’te's  n<Ka'  ng  »ts  type  (I  INTERNAL,  x E.*iT, 
A AYC-E,  E-END.  Q-D'j.CkSEE)  Tn-s  abb'eva'ea  o ctor  ai  -epre'enfation  is  used 
tnrojgnout  tne  rest  o‘  *,^e  tne  s ''he  V,ua " '*'tra:nur'k  "*.*  (those  de* -ed 
p^ev-ousiyi  a»e  <mp.>ed  to  e*  st  On,/  lm*s  ne**een  image  chunks  a.*e  mocated  'by 
the  arrows*  to  Pos  ' on  e'e^ents  *'t  r.cluded  m these  drJ*n  representa?  ons  e tner 
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The  E*.D  elements,  whan  used  in  a SIDE  chunk  image  body,  iKh  Mvi  only  on* 
ntr achunk  link  ivi  iabi*  for  traversal  (LSI).  Thus,  a SIDE  chunk  allows  traversal  ovar 
only  ona  “tide*  of  tha  iina-ika  image  structure  it  represents.  At  with  LINE  chunks,  a 
QUICKSEE  a la  men'  may  occur  m a SIDE  chunk  to  partially  rapratant  an  mcludad 
(att  milatadl  ve*te*  It  it  the  only  image  bouy  ttructura  which  it  not  a doubly -directed 
htt  (ring)  of  elementt.  Tha  other  ‘tide*  (of  tha  object's  tide)  it  travertabla  only  within 
the  related  OBJECT  chunk.  Tha  SIDE  mjy  rapratant  vituai  information  to  tha  Outtide 
Of  tha  object  at  shown  by  figure  IIL 1 1.  Or  it  may  rapratant  information  occurring 
w,th  n tha  Object  contour  (at  thown  by  Figure  111.19)  Only  a representation  of  the 
ob,ect  contour  it  in  an  OBJECT  chunk.  Any  contestusi  interaction  with  an  object  *tde* 
it  represented  in  a SIDE  chunk. 

FACE  CHUNK 

The  FACE  type  ir  age  chunk  hat  image  chunk  characteristics  eomvelent  to  the  use 
of  an  OBJECT  chunk.  Chapter  1.5  (on  attentions  to  tha  implemented  VIPS)  itates  that  a 
three-dimensional  projection  of  a pntm-typa  object  it  visually  perceived  at  consisting 
of  a 'prune  face*  end  aero  or  more  related  'secondary*  faces.  This  prune  face  is 
represented  by  an  OBJECT  lyra  chunk,  with  (i-a  DIM  (dimension)  property  of  the 
Chunk  Header  specified  at  THREE.  All  secondary  facet  included  in  the  image  ere 
represented  m related  FACE  chunks  The  Chunk  Header  element  of  a FACE  chunk  does 
not  have  a NAME  property  associated  with  it.  The  name  ot  a three-dimensional  object 
it  determined  by  the  nemo  of  the  prime  face  chunk  Figure  111.  1 2 illustrates  the  use  of 
FACE  type  chunks  m the  contest  ot  a cubic  image 

The  Chunk  Header  element  of  a FACE  chunk  and  of  a three -dimension  OBJECT 
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chu^-s.  has  two  spec  a1  assoc  ated  properties,  90IR  and  FDIR  FDW  specifies  the  facial 
©■tension  d rect  or  ot  tre  pr  static  p'o,*  t er,  and  BDIR  specifies  the  depth 
dr^ct'Onfst  assoc  a*ed  w th  tre  ob;eet*s  percept  on  (FDIR  end  BOIR  are  the  sen*#, 
except  \*ken  FQIP  ,*  down  ?ee  Oap’er  15).  The  -mage  body  ot  a FACE  chunk  is 
Mr  a gM  - fO’wa’dty  gererafed  fro**  a spec  t.cat  on  ot  FCIR  and  the  orientation  ot  th# 
hne  segment  (o*  tre  prime  face)  from  w*'fh  it  e»tends 

^erceotua  i/  C'ea’ed  depth  at-on*  or  rg  * tn  |he*n  a thr  d d-mens  on  tor  local. on 
fpo*.  t *pe  • cat  on  A such,  'i**e»<?nced  Pos  t on  tfpe  elements  are  mod* t ed  by 
t e addition  ot  '"re  re*-  p'Ope’tes  P*.PP,  PuDP.  PTflP  (Perceived  Front-Back 
Pos  ‘-on  PLPP  and  PuDP  assume  va'  jvs  ‘'om  tn«f  same  ass  as  tPP  and  U0P  $ ar 
to  t»  e O'hO'hg  of  a se  t"  b/  se.en  f *o  a mens. on  a gr.o  to  the  visu*  ted  of  inte'est, 
the  pe'reptua  process  o nds  a s-ve*  va'ued  cep»*  sea  e to  tre  visual  f-ef o (FlO  (Front 
)n*  FM5.  FSrt.  0*1,  ftt  « f0ac*c  Sno*t).  3.0)  Tnese  symbols  constitute  the  class 
o?  i y <■  oe  a ues  tor  PF0P  >e  adw ' on  ot  tre  three  re*  pos>t  on  e'ement 
D'0pef  f es  "fans  that  a group  o*  v s„a  featjres  of  a p cture  l a vtrte*)  s perceived 
'o  d at  two  'Merre-ated  ocat  ons  Ore  iOcat-on  s n terms  of  th#  p eture  plant  (IRP 
a^n  OP;  a^d  one  n <n  terms  o*  tre  perceptually  created  three -d<mentional  space 
(PVPD,  PuDP,  PrQP) 

ne  b nd  r g of  this  depth  scae  adds  the  tn.rd  d-mens-onal  ans  to  the  dmansiOnal 
^r  d def  ied  b,  the  iRP  and  I'DP  bind-rg  The  resultant  pro,ectionai  p'ane  (space) 
d t*ers  from  o usual  (mathemat-ca'iy  denned)  one  n tnat  the  of'gin  of  the  depth  a«>s 
need  not  come  de  w th  the  two  d-menS'Cnal  ong.n.  F(gure  III  I3  illustrates  this  idea, 
tre  depth  or  g n be*ng  bound  to  the  (L$H,  U$H)  planar  location.  The  back  directon 
(BDIR)  of  tnat  a*  s in  Figure  Iii.13  is  up  - right  (UR).  Th.s  direction  plays  a special  rol# 


m the  perceptual  assignment  of  locations  (PlRP,  PjQP,  PF0P)  Only  line  segments  »n 
!re  same  orientation  as  the  dep*n  ans  (UR  - DO  may  (not  all  ara)  oe  assigned  depth 
meaning  and  accord  ng  / a**ect  pe  ' e.ed  ocahon  Tnis  necessarily  adds  a dimension 
Of  pi»"  eptual  amp  gj.ty  (dua  ty)  to  tne  peture  p re 

gjre  ill  Id  illustrates  '''at  '•ot  a re  segments  in  tne  deptn  a*  s or-entahon  are 
ass^ned  depth  mia^ng  l re  segment  “a"  s bound  to  tne  prime  ttrape*o<dal>  face, 
w"lCh  s perce  ved  to  be  pa-a  e to  the  picture  o ane  F.gure  JIM5  illustrates  the 
oc at  onat  amb'guty  of  tne  percaptua1  pro.ectiona,  p ane  Start  at  po>nt  "o"  Moving  to 
pomt  "A"  on  Ime  segment  a (as  part  of  tn#  cube.  <5  p<  eptua.iy  interpreted  as  a 
movement  m depth  (bacO  Mov-ng  f'om  V to  point  "A*  on  side  P then  on  side  c (as 
part  of  the  triarge  s a movement  on  the  picture  p ane  Subjects  d>d  per  eve  this 
picture  as  nterreiated  cube  and  tr  ang'e  (see  F gore  III. i 6 >.  Th#ir  descriptions  end 
draw  ng  behavior  indicate  a duality  of  locationa*  specification  (PlRP,  PUDP,  PFflP  ano 
t»P,  UDP). 

Anecdota  e«per  menta'  resu  ts  led  to  and  tnus  support  these  proposed  property 
add  T*ons  and  the-r  mean.rg  Three  dimensional  locat-on  specifications  were  used  (i.e 
’bac<  there*,  "in  front  of  tna?")  Whan  traversing  rnts  in  the  BD!R  direction,  subjects 
often  wou  d sa/  go  ng  bac*“  or  “now  back  here*.  Yet  perceptual  inferences  were 
made  wl  ch  indicated  t >e  ma  ntenance  of  the  picture  plane  location  features  in 
conjunction  with  the  three  d menvonai  features  used  m the  protocols  verbaliiatiors. 
Also,  the  ‘rbal  descrip'.  ons  employed  three«dimtns*Onil  terms  while  the  drawing 
behavior  nd'tated  picture  plan#  positional  knowledge.  Several  picture  perceptions 
interspersed  three  and  two  dimensional  objects,  egl'n  interrfletng  two  and  throo 
dimensional  picture  features  (see  F gure  IV 15).  Chapter  1.5  discusses  three 
d mens'onal  picture  perception  and  relevant  protocols. 
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INTERCHUN*  RELATIONSHIPS 
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INTERNAL  element  ot  an  OBJECT  chunk  may  be  „.,v»len.iy  -Led  to  an  END  ...  . 

ot  . SIDE  chunk.  E.ure  *1.  - - - - ~ ~ ^ 
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properties.  Figure  111.18  illustrates  the  use  el  this  inter  chunk  relation.  An  ANGIE 
element  ol  t VERTEX  chunk  is  linked  to  one  in  an  OBJECT  chunk  as  a means  ol 
representing  the  contest  at  an  object  'corner*. 

The  two  INTERNAL  elements  ol  an  OBJECT  chunk  'corner*  conltguration  may  be 
equivalently  linked  to  two  XIT  elements  ol  a related  VERTEX  chunk.  This  occurs  in  the 
case  ol  an  object  being  perceived  at  containing  a line  (intide  the  contour)  originating 
at  that  object  corner  Figure  I1L19  illustrates  the  use  ol  these  links  (links  a and  b). 
This  ligure  illustrates  the  use  ol  a SIDE  chunk  to  represent  the  ‘inside*  edge  ol  an 
object's  side.  This  ligure  alto  illustrates  the  equivalency  link  (links  c and  d)  which  is 
used  between  an  XIT  element  and  an  ENO  (ol  a LINE  type  chunk)  element.  The 
erte'nal  link  ol  an  ENO  element  ol  a LINE  chunk  is  an  equivalency  link. 

The  other  type  ol  inter -chunk  links  are  space -traversing  in  meaning  These  links 
occur  between  two  XIT  elements  ol  diltonng  LINE,  S10E,  or  VERTEX  chunks.  Figure 
111  20  illustrates  the  use  ol  these  links  (*a*)  between  a LINE  ar-’  several  VERTEX 
chunks.  The  three  properties  QVX  (Direction  ol  Verier  eXit),  LVX  (Link  ol  Verier  eXit), 
and  RVX  (Range  ol  Verier  eXit)  serve  to  specily  these  links. 

EQUIVALENCY  AND  REDUNDANCY 

The  use  ol  equivalency  links  to  interrelate  image  chunks  introduces  a necessary 
degree  ol  redundancy  into  the  visual  image  representation  This  redundancy  is  a 
fundamental  aspect  ol  the  semantic  nature  ol  the  visuei  image.  A line  segment 
between  two  objects  is  meaningfully  part  of  both  image  concepts  Figure  - ground 
phenomenon  cons>deretions  require  that  this  part  be  included  in  each  ol  the  two  image 
chunks.  Similarly,  angles  ere  seen  es  part  of  an  object  and  as  pert  ol  a compter 
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ve'ten  where  several  object  corners  imj  meet  The  use  Of  equivalency  links  are  an 
essentia'  factor  n the  real  za:  on  of  input  assim.lat'On.  A compien  varies  is  readily 
ass'miated  as  object  environ'  :onte«t)  during  parcaptual  proce.smg  These 
equ'  a'ency  links  a so  provide  the  necessary  means  of  image  traversal  Ipass.ng) 
cetween  chunks  (concepts).  Tn.s  traversal  allows  the  behavior  necessary  to  enpla  n 
the  perceptual  (verbal)  descnptio-  and  drawing  activities. 

IMAGE  WEPiiestnlAriON  FIEXIBILITV 

To  satisfy  the  design  criteria  1,  2.  and  3,  a most  necessary  characteristic  was 
(legibility  of  image  representation.  "Flembilit y ot  image  representation*  means  that 
one  single  line  draw.ng  must  be  representab'e  in  more  than  one  way,  reflecting  the 
diversity  of  cut  t behaviors  and  resultant  perceptions  observed  with  regards  to  a 
single  line  drawing. 

The  Figures  IIU7  • 11LJO  illustrate  the  fteiibikty  of  the  proposed  image 
representation.  Figures  111.17(a)  - 111.20(a)  evemplify  the  general  dess  of  verbal 
description  which  is  associated  with  each  respective  image  repre  ant  at  ion  of  that  one 
line  drawing. 

The  redundancy  and  fleaibility  of  the  imegf  representation,  the  non-hterarchtcal 
nature  of  the  image  body  structures,  and  the  ipetiM  and  equivalency  meaning  of  the 
element  interrelations  are  the  mam  design  feature'  which  allow  adequate  satisfaction 
of  the  design  criteria  specified.  The  propOMi  of  thi  various  image  body  elements  and 
their  associated  interrelationships  yield  these  representation  capabilities. 


Figure  111.17(a) 

Thoro  is  a square  next  to  a triangle 
the  square  la  to  the  loft  of  the  trianrle 

Figure  Hl.lKa) 

There  is  square 

which  n;ot->  t triangle  to  the  rifht 

nectir.~  at  the  top  anl  bottom  corners  of  thot  side 

Figura  111.19(a) 

Thera  is  u trapezoid 

which  has  a line  from  its  obtuse  corner 
to  th'  bottom 

Figure  111.20(a) 

There  is  a rip.ht  an.;le  in  tho  lower  left 

above  ti  nt  in  another  rit.ht  nn>  lo 

then  to  t'  e riidit  is  a throe-oxit  vortex 

lines  r,o  down  and  lown-rinht  from  there  to  hit  the  botton 
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3.  Tha  Image  in  VIPS 

Chapter  1.4  will  discuss  how  tho  visual  image  eervee  to  guide  the  perceptual 
behavior  of  VIPS  as  chunks  STM,  and  how,  as  each  STM  chunk  is  visually  confirmed  end 
meaningfully  integrated  into  the  image,  these  chunks  are  transferred  to  ITU  ITM  is 
the  residence  of  the  complete  fmelned  visual  image  (perception)  resulting  from  the 
activity  of  VIPS. 

The  image  chunks  of  STM  are  interrelated  by  equivalency  and  space  traversing 
links,  as  discussed  above  When  these  chunks  are  incorporated  into  ITM  further 
relational  links  are  added.  These  new  links  are  between  the  Chunk  Header  elements  of 
related  image  chunks.  The  incorporation  of  image  chunks  is  sequential  as  indicated. 
The  order  of  object  image  chunk  incorporation  is  represented  esplicitly  by  the  piecing 
Ot  a (NEXT  09)  relational  property  on  the  currently  last  ITM  obiect  w uch  is  set  to 
reference  the  new  object  image  chunk  upon  its  incorporation  Furthermore,  an  object 
image  is  incorporated  together  with  its  immediate  environment  as  determined  b.  tne 
emst  "g  equivalency  li.irs  of  its  image  body  elements.  A props’ty  (ENV)  is  added  ts  an 
object's  Chunk  Header  during  incorporation.  This  prope  l,  has  as  value  a list  of  those 
image  body  elements  which  have  an  mter-chunk  equivalency  lir.k.  These  elements 
themse  ves  become  properties  of  the  object's  Chunk  Header.  Each  has  as  value  the 
Chunk  Header  of  the  image  chunk  which  contains  the  image  body  element  to  which  it  is 
linked  by  equivalency. 

One  perceptual  strategy  (see  Chapter  11.1)  ir.,olves  the  perception  of  the  picture 
Outline.  As  chunks  representing  parts  ot  this  Outline  are  incorporated  environmental 
links  are  added  between  Chunk  Headers.  These  involve  the  use  of  the  ENV  properly 
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•nd  the  image  body  properties  M with  object  incorporation  but  the  inter -chunk  links 
in  this  case  may  be  space-traversing  alto 

Figure  21(a),  (b),  >c)  ana  Figure  22(a),  (b),  (cl  illu-.iraU  two  image  representations 
produced  by  VIPS  during  the  explanation  cl  Uo  protoco  s upon  the  same  line  drawing 
The  component  (a)  0 1 each  tigura  presents  the  subject's  verbal  description 
Component  (b)  presents  the  image's  pictor  ai  representation  as  shown  before. 
Component  (c)  presents  the  Chunk  Header  structure  produceo  by  chunk  incorporation 
into  1TM.  The  doubly  directed  links  are  environments1  links.  The  uni-directionui  ootted 
links  ere  the  NEXT-03  links  mentioned  above.  The  figure  also  indicates  the  order  that 
the  visual  concepts  (chunks)  ot  the  image  are  noted  in  the  subject's  description. 

The  flenbility  ol  the  representation  is  again  illustrated  by  these  two  esamples. 
Furthermore,  trie  use  ol  both  the  equivalency  and  spatial  links  between  im..e  bodies 
and  the  relational  links  between  Chunk  Headers  appears  to  be  basic  to  an  eiplenation 
ot  the  verbal  and  drawing  descriptive  behavior 

Figure  21(c)  includes  a verba  nation  by  VIPS  which  is  based  upon  NEXT-OB  link 
traversal  only  Figure  21(a)  shows  that  these  object  concepts  occur  in  the  same  order 
(by  (i),  (u),  (in)  end  (iv )).  Section  A ol  the  verbaliiehon  is  derivable  from  the  Chunk 
Header  (environmental)  links  Section  B indicates  image  body  traversal  ol  the 
rectangle  (0184)  image  and  ol  the  equivalency  link  between  that  image  end  that  ol 
S101  Section  C again  is  derivable  solely  from  the  environmental  links  ol  the  Chunk 
Header 

The  verbal'iation  ot  Figure  22(a)  employs  the  image  body  links  to  a greater 
degree.  The  first  section  (A)  is  derivable  from  Chunk  Header  links.  All  of  the  rest  (B) 
ol  that  verbal  description  is  the  verbelitetion  of  a traversal  of  the  image  chunks 
according  to  the  inter-chunk  image  body  links  pining  them. 
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The  Chunk  Header  re'-otions  to  1TM  add  a dimension  of  hierarchy  to  the  image 
representation  beyond  that  implied  by  the  chunking  of  the  visual  information.  The  final 
form  of  the  visual  image  in  VIPS  (the  perception  found  in  ITM)  is  a heterarchical 
symbol  structure. 


rijure  111.21(1 
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okay 

un 

I have  a three-sidoi  triangle 

which  intersects  a square  on  the  right 

there  is  3 rectangle 

on  top  of  the  square  on  the  right 

un 

this  rectangle 
un 

has  one  side 

that  is  tho  sane  side  as  the  square 
that's  on  the  loft  of  the  square 
ani 

then  the  rectangle 
go63  to  the  right 
and  cones  down 
and  lntoroects 
the  square 
un 

on  top  of  the  square 

and  then  coning  oTf  this  rectangle 

ia  a four-sided  object 

which  pulls  the  whole  drawing  together 

the  four-sided  figure  has  a&des 

on  the  rectangle 

the  triangle 

and  the  square 


(1) 

(ii) 

(iii) 


(lv) 


/ 


62c 


Figure  111.22(a) 


okay 

the  whole  thine 
wo  have 

uh 

we  have  a triangle  in  the  lower  left  hand  corner 

ar.J  we  have  a vertical  coming  up  to  that 

and  it.  .its  a horizontal  over  there  on  the  top 

in  1 

( pause > 

a vertical  goes  down  to  the  right 
a vortical  roes  down 
and  it  hits  a horizontal 

you  r,o  over  to  the  right  and  there  is  a right  angle 

you  nov#  down  to  tho  left  there's  a right 

you  novo  down  there's 

a right  angle 

ani  there  Is  a bottom 
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Tha  purpose  of  th»  chapter  it  two-fold  It  tin'  presents  a specification  ot  the 
memories  and  processes  which  are  coordinated  participants  in  visual  perception.  It 
than  illustates  these  components  m action  by  presenting  an  trample  segment  ot  a 
trace  of  VIPS  activity.  The  image  representation  is  also  demonstrated  at  a guide  tor 
this  activity. 

1.  System  Overview 

Throughout  the  development  ot  VIPS  tha  proliferation  of  memories  and  processes 
was  accepted,  indeed  considered  velueble,  when  such  proliferation  enpedited  system 
design,  function,  and  description.  This  proliferation  was  tempered  by  the  requirement 
that  favorable  enpenmental  indications  for  any  memory  proposal  eaist.  As  a result,  the 
p-oposed  system  is  composed  of  sir  memories  and  four  processes,  named  as  fotows: 


1.  Picture  (PIC) (an  erternal  memory) 

2.  Visual  Register  (VR) 

3.  Short  Term  Memory  (STM) 

4.  Long  Term  Memory  (LTM) 

5.  Recognition  Long  Term  Memory  (RLTM)  (long  term  memory  components) 
4.  Intermediate  Term  Memory  (ITM) 


Processes: 

1 . Assimilation  • Accomodation  process  (AA-SYS) 

2.  Visual  Input  process  (VI-SVS) 

3.  Recognition  process  (REC-SYS) 

4.  Incorporation  process  (INC-SYS) 


THE  MEMORIES 


The  memories  of  VIPS  differ  m several  primary  characteristic*.  which  « 've  to 
distinguish  end  define  eecH  memory.  These  characteristics  art: 


1 the  associated  overall  (sup'a-e>ementel>  information  structure. 

2.  the  internal  characteristics  and  structure  Of  the  contained 
memory  elements; 

3.  the  variability  (m  terms  o'  addition  of,  alteration  of,  and 
loss  of  contained  elements)  through  the  performance  of  a 
perceptual  task; 

4.  the  allowed  means  of  information  accessing; 

b the  associated  processes  (those  which  can  access  the  memory, 
and  how  each  can  effect  the  memory). 


The  memories  are  not  separate  storage  compartment-,  of  the  cognitive  processor, 
though  computer  mpiementat'On  fosters  tn-s  interpretation.  Each  active  memory  is 
defined  by  the  functional  ro'e  which  its  contents  play  in  the  perceptual  activity 
undertaken  by  the  system  A symool  o*  sympo  structure  may  be  sa>d  to  be  m one  of 
the  active  memories  (STM  or  a cell  of  VP)  when  .t  plays  the  associated  processing  role. 

figure  IV. I indicates  the  accessibility  relationships  between  the  constituent 
memories  and  processes  of  VIPS  An  arrow  from  a memory  to  a process  indicates  that 
the  process  can  access  nforma’-on  from  that  memory  by  that  memory’s  associated 
accessing  means.  An  arrow  from  a process  to  a memory  indicates  that  tn#  process  can 
after  that  memor y by  entering  new  eiem#n;s  or  changing  ousting  ones.  (Note  th§t  ITM 
it  not  shown,  its  elements  permeating  toamg)  a't  memories  end  processes.) 

figure  IV.2  Ihowt  the  poss  pie  inter -memory  transfers  of  information  Within  the 
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system.  Each  arrow  it  labelled  with  the  process  capable  ot  performing  the  indicated, 
directed  mfC'matiOn  transfer  This  figure  indicates  the  flow  of  visual  information 
within  VIPS.  It  is  redundant  with  Figure  IV.  I but  emphasues  e different  system  aspect. 

1.  PIC  (Picture) 

PIC  is  an  eiternal  memory  (Newell  and  Simon,  1972)  and  the  source  Of  visual  input 
information  in  VIPS  Oue  to  the  nature  ot  perceptual  processing,  which  VIPS  models, 
the  system  must  represent  both  subject  end  environment  in  order  to  eiplein  the 
behavior.  As  such,  PIC  is  tnat  part  of  VIPS  which  represents  the  environment. 

Elsewhere  I have  defined  perception  to  be  the  active  process  by  which  an 
organism  interprets  the  states  of  a subset  of  its  cells  (Farley,  1971).  Given  sufficient 
organism  complenty,  these  cells  are  subsets  ot  an  organism's  nervous  system,  being 
called  sensory  receptors.  The  significant  feature  of  sensory  receptor  cells  is  their 
direct,  or  effective,  link  with  the  organism's  surface  This  feature  leads  the  organism 
to  believe  that  the  sensory  receptor  states  indicate  conditions  of  s surrounding, 
impinging  environment.  That  this  belief  is  reality  or  illusion  appears  phenomenally 
ndetermmant. 

In  the  human  organism,  the  receptor  cell  states  whtch  ere  interpreted  during 
visual  perception  are  those  of  the  rod  and  cone  cells  of  the  eye  as  organ  red  to 
"receptive  f olds"  at  the  retina  (le'bovic,  1972).  These  celts  (states)  form  the  visual 
environment  This  is  the  environment  represented  by  PIC  This  is  the  meet  eiternal 
that  any  memory  can  be  said  to  be.  It  is  the  environment  in  terms  Of  sensory  rather 
than  physical  qualities. 

Since  involvement  with  actual  camera  mput  was  to  be  avoided  as  necessarily 
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pOS  ng  add't.onai  p cbems  Out*.  de  I''®  ream  0*  me  tness  , ^ -ntermed-a te  Oe  -0*  *e 
representaton  o*  tne  picture  wit  neeaeo.  The  ^presentation  cnos^n  tor  trvs 
description  is  a ist  cf  v®''e>  descriptions,  each  verte*  descr-pton  being  a ' near  hst  of 
verte*  features  This  ve  te*  representation  has  tne  characters?*  of  be-ng  cons  stent 
with  feature  a*a  ysis  and  e»traction  propasas  for  the  ro!e  of  the  eye  n vnua* 
perception.  Various  nejreo>ogtca>  ano  psychophys  ca<  studes  have  mdcated  tre 
apparent  feature  extract  c"  caoao  ’es  of  the  e>e  sub*S)S?em  of  me  vsu«*i  processor 
(•or  rele'ences  see  Cnao’er  V 1 ).  Tnese  st-ides  .nacate  that  this  anal>S'S  rr.a/  be 
effected  by  a high-orde»  pe'cepmon  «t  process  iMjntj,  IS’l'  Uhr  U973'  d scusses 
means  for  the  computer  impiemeMahon  o*  this  "^ont-tno"  of  visu»:  form  perception 
activity  Each  ve'tei  representation  of  ?IC  s p'ooostd  as  be-ng  analogous  to  a J»st  of 
features  wh.ch  tne  eye  coud  retr.evt  at  mat  verte*  oca’ion.  The  hst  of  verte* 
oescr.ptons  compr.sing  P JC  re-ri-j  co-stant  throutnout  the  perceptual  ectivty  o* 
VIPS 

Obson  (1966)  has  descr-bed  the  senses  as  tne  active  system*  which  'eg  ster  the 
"invariant  structures  of  ava'abc  st-m^ahon  furmshed  at  tne  'ecepto*s"  The  theory 
of  ViP$  agrees  that  structure  does  e«st  .n  v*ua’  st  mu  at  on  a*d  tnat  >t  is  registered 
during  perceptua1  activity.  But  it  argues  tnat  m,»  s only  an  in.t.at  level  of  processing 
Structure  exists  as  potential  irformat.O'  m me  environment.  The  m.tiai  level  of 
perceptual  processing  transforms  *,at  structure  into  symbols  and  r®  at.ons  which  are 
known  by  the  organism  <o«,  »no:og'Ca  informat.o®)  Tne  results  of  this  O'rect  analysis 
ar#  *ou*d  *n  PIC,  and  poss  b*r  VI  as  tre  icon  .»  automatical  co  nstructed.  The  visual 
•mage  produced  by  visual  perception  m STM  anp  ITM  n t • result  of  constructive 
activity  which  s »*fiu#nc*d  by  goals  that  a-t  oeyonp  the  mere  registration  of 
stimutat  on  structure  (reton#  *e). 
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~n«  procett  Vt-SYS  if  the  only  pr  octet  with  kcii>  10  the  Picture  memory  Tnit 
acceit  i*  accomphthed  by  mean*  of  'ne  Picture  memory’*  attociated  reference  pointer, 
the  Current  Picture  Pointer  (CPP)  r"  pointer  a'wayl  reference*  one  of  the  »»’te< 
ante  pt  on  *tt,  be  ■[  anjiogou*  to  tne  Current  ho'e  pot  i on  of  the  primary 
n.pnr. mentef  tat«  * tuat  on  Each  vertei  oetcription  lit!  alto  contain*  tne  necettary 
'pat  a r'ormation  to  facilitate  tne  repovt'On.ng  ot  C PP  in  a way  anjiogou*  to  that  of 
ho'e  movement.  That  it  by  cpecificat  on  ot  a direction  ot  hole  movement  ISee 
Append'*  APIC2  tor  an  eaamp.e  of  a PIC  repretentatiOn  and  detail*  of  the  vertea 
feature*  and  *patiai  mterreiatiOnthip*  uted.) 

2 VP  (Vituel  Pejuter) 

The  vituel  rejute'  con*  *t*  of  five  independent  cent  of  information,  the»e  being: 

A DIP  - direction  (of  eye-hoie  movement) 

B.  PAN  - range  (ot  eye-hole  movement) 

C.  EXP  - eapectation 

0.  ATT  - attention 

E VI  - vituel  information 

Tn.t  memory  it  util. led  m VIPS  at  a communication  regitter  between  the  VI-SVS 
procett  and  the  AA-SYS  procett  end,  at  tuch,  It  highly  veritbte  throughout  the 
performance  of  a perceptual  tatt,  with  both  procettet  having  the  ability  to  inapect 
and  alter  it*  component  cella.  DIP  and  ATT  may  be  null,  O'  contain  a directionally 
mee  ngful  imago  aymbo'  RAN  may  be  null  or  contain  an  image  lymbol  repreaenting 
d ttance.  EXP  may  bo  nu'l  or  contain  an  image  ang'e  tymbol  Or  hat  Of  vortoe 
ipec  tication  aymbola.  VI  may  lihew.te  be  null  or  contain  a partial  Or  complete  imago 
ttructure  having  ta  origin  m VI  SYS  procett  operation. 
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VI 


The  VI  tall  is  proposed  M the  equivalent  of  ti  a so-called  Sperling  (Sparling,  1960) 
or  iconic  (Neisser,  1967)  vitual  mamory.  Upon  VI$Y$  activation  VI  it  always  empty 
<* «.  * to  a null  value).  At  the  time  ot  VI-SYS  deactivation,  tn#  call  contains  an  image 
representation  (chunk)  of  the  new  visual  information  acquired  by  the  changing  of 
fuation  (hole)  location.  This  iconic  image  m VI  it  the  result  of  the  first  (two)  ot  several 
active  stages  of  information  processing  and  abstraction  (Posner,  1969).  Sternberg 
(1967)  observed  reaction  tune  differences  indicating  the  presence  ot  such  a stage  ot 
visual  representation  prior  to  the  application  of  recognition  operations. 

Visual  information,  as  it  appears  in  VI,  has  not  yet  been  spatially  integrated  into  or 
in  any  meaningful  way  associated  with  the  current  perceptual  image  contents  of  STM. 
This  is  one  basic  characteristic  of  the  visual  icon  which  has  been  inferred  from 
experimental  results  (Haber  \ 1971).  Another  is  the  independence  of  its  contents  from 
the  influence  of  any  active  perceptual  goal.  Although  perceptual  goals  play  a prime 
role  in  VIPS,  the  functioning  of  Vl-SYS  is  only  dependent  upon  the  contents  of  PIC  and 
the  Visual  Register.  This  provides  lor  the  desired  goal  independence  of  the  resultant  VI 
cell  contents.  Given  visual  register  specifications  tor  the  movement  of  CPP  (the  hole), 
the  encoding  of  information  into  VI  (the  icon)  is  'automatic*  (Shilfrm  and  Geislei  .973). 
Finally,  the  results  of  visual  masking  experimentation  indicate  that  the  icon  is 
susceptible  to  erasure  from  overwriting  VI  also  has  this  characteristic  as  it  is  set  to 
null  then  reconstructed  with  each  activation  of  VI-$Y$.  The  representation  of  visual 
information  in  VI  in  the  present  implementation  is  that  of  an  image  chunk.  A possibly 
better  choice  is  that  of  just  the  vertex  feature  list  itself,  allowing  greater  flexibility  of 
STM  representation. 
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EXP  end  ATT 

The  EXP  and  ATT  cells  provide  the  information  necessary  for  the  operation  of 
"preattentive  function*",  which  the  perceptual  system  (through  VI-SVS)  find* 
advantageous  to  apply.  The  "preattentive  functions*  of  VIPS  differ  from  the  whoiittic 
type  described  by  Neisser  (1967),  but  they  serve  similar  purposes. 

The  EXP  cell  allows  the  Vl-SYS  process  to  apply  a function  capable  of 
immediately  determining  whether  a specified  visual  feature  or  feature  configuration  is 
found  within  the  newly  acquired  information.  The  function  application  is  immediate 
operating  in  conjunction  with  iconic  image  construction  It  precedes  any  effect  by  the 
new  input  upon  the  current  image  contents  of  STM.  The  contents  of  VI  are  not  affected 
by  the  operation  of  an  expectation  function.  The  use  of  espectalion  operations  in 
visual  perception  has  been  indicated  by  various  espenmentaf  results  ( Aon r men  and 
Smith,  1971).  In  VIPS,  the  EXP  ceil  is  loaded  with  the  aspects*  visual  feature  vafuots) 
prior  to  VI-SVS  activation  An  appropriate  preettentive  function  is  applied  by  VI-SVS 
wnenever  this  cell  has  been  prespecified  (by  AA-SYS).  The  result*  ol  the  function 
activity  (YES  , NO  , or  CONtemed)  is  placed  in  EXP  prior  to  deactivation  of  the  Vl-SYS 
process.  In  sons  case*  the  returned  value  of  EXP  is  sufficient  to  determine 
subsequent  perceptual  behavior  (by  AA-SYS).  In  such  case-,  v'l  is  not  accessed  nor 
incorporated  into  STM.  The  estent  of  evaluation  of  newty  arriving  sensory  input 
depends  upon  the  predisposition  of  the  system. 

The  ATT  cell  allows  the  Vl-SYS  process  to  bypass  vortices  of  negligible  interest 
to  the  present  porcoptual  goal  when  moving  to  a new  (nation  location  (vortex).  The 
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evemovement  results  ct  Yarfcus  <1*6  \)  _s‘rate  t r.*.  ao  .ty  of  t*e  .-•sua'  s,s*em  in 
MP$,  the  ATT  ceil  may  oe  specif-ed  wth  a direct  c a j«  perpe-d-cu'ar  to  that  of 
the  specified  movement  d rect  on  iDIR)  prior  to  VI-SYb  actuation.  As  such,  ATT 
specifies  a side  of  the  I ne  segment  whicn  is  being  traversed  Any  verte«  encountered 
during  hole  movement  which  is  stra  ^ht  jn  tne  s de  of  the  i-ne  speeded  Oy  ATT  is 
scanned  through  ino  halt)  on  the  way  to  a further  ne*  f >at<on  location  (verte* * 

DIP  and  RAN 

The  DiR  and  RAN  ce  s ae  these  nformjto''  units  wh.cn  pruv  de  for  tho  necessary 
com^un  cat  on  oetwean  tne  v-suai  mtormat  on  processor  (viSua  corte«>  ana  the  motor 
cont-oi  p-ocessor  (ce'eoenum  or  oasai  ganglia)  IE.  V Evicts,  1973‘,  wmch  controls  t*e 
spec  t ed  bod,,  head,  or  eye  vhole>  movement  act  vity  ’hese  movements  are  specified 
m terms  of  d rect  on  (OiR  and  ra"ge  (RAN)  at  tn-s  con’-oi  ie-e  \eutoph/s  oiog<ca‘ 
research  (Proram,  19?D  has  inacateo  such  an  abstract  'ep'esentat  o*  of  motor 
functions  at  tne  corte»  eve 

DIR  and  RAN  ndicatc  tne  intrinsic  ro>  of  motor  \e»‘erent)  act>v>ty  and  -nforma!  On 
n vsuai  perception  Movement  .*  necessary  ’or  tne  f.vaton  o*  new  eate'nai 
ihform4t,on  Ojt  these  cells  do  not  on,/  provide  n’jrnat'On  for  V!-$Y$  to  efte't  SuCn 
movemen*  Their  spat  a'ly  mean.ngfyl  values  <syribo's)  are  incorporated  into  the  v-suai 
mage  structure  itself  by  AA-SYS.  RAN  s a vaue  returned  from  the  motor  system  in 
the  hole-movement  tasK  (so  j'O  >n  VIPS*  Neurophysio  og  a results  ha  c indexed 
that  the  cOrtev  can  not  be  parttio'ed  soie'y  On  the  bas-s  of  sensory  or  efferent  nerve 
input  connections  The  mterpretat.on  of  sensory  nerve  states  (perception)  involves 
the  interpretation  of  associated  efferent  nerve  states  (festinger  et  a>,  1967).  Eye 
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movement  research  has  indicated  the  effects  of  eye  movements  upon  perceived 
position  end  motion. 

3.  STM  (Short  Term  Memory) 

The  Short  Term  Msmory  of  VIPS  correpcnds  to  the  notion  of  short  term  memory 
under  discussion  m cognitive  psychology  today  (Miller,  1956;  Newell  and  Simon,  1172) 
It  represents  that  limited  part  of  human  memory  which  is  active  or  has  recently  been 
active  and  is  still  readily  accessible  As  such,  STM  is  an  ordered  list  of  a constant 
number  of  independent  chunks.  A chunk  is  a collection  of  symbolic  ir'ormation  such 
trat  access  to  any  constituent  element  of  a chunk  implies  the  immediate  accessibility  of 
all  other  constituent  elements.  A chunk  is  not  an  independent  unit  of  memory,  though. 
It  is  rather  a pseudo  self-contained  symbol  structure  II  is  e selective  activation  of  the 
symbols  and  relations  of  ITM  Eacn  seeded  symbol  ma.ntams  the  potential  use 
(activation)  of  all  of  its  LTM  associations  by  the  active  process  The  number  o*  chunks 
m STM  has  been  set  at  nine  in  VIPS.  This  number  ,s  with  - the  limits  of  Current 
est  mates  of  STM  chunk  capac  !y.  Chapter  shows  that  the  numbe-  n.ne  is 
necessary  to  eiplam  the  observed  behavior  with  the  present  VIPS  process 
implementations.  The  three  processes  (AA-SVS,  REC-SVS,  INC-S75)  other  than  VI-SVS 
all  have  access  to  the  chunks  of  STM 

The  order  of  chunks  m STM  is  the  result  Of  (he  acton  of  two  basic  STM 
operations  The  first  is  the  insertion  of  I new  chunk  at  the  head  Of  STM  This  chunk 
may  be  created  by  the  currently  active  process  or  may  be  transferred  from  ITM  or  the 
VI  cell  of  the  Visual  Register  This  insertion  results  m the  "pushing"  of  the  busting 
STM  chunks  to  the  back  end  causing  the  lest  chunk  to  bd  lost,  or  "forgotten*.  This 


n 


keeps  the  number  of  STM  chunks  constant  The  second  operation  is  the  movement  ol 
a current  chunk  of  STM  to  the  Iront  ot  STM  This  results  from  the  'attendance* 
(accessing)  of  the  chunk  by  the  active  process  (either  AA-SVS,  REC-SYS,  or  INC-SVS). 

Chunks  are  only  lost  from  STM  by  displacement.  There  is  no  enplicit  decay  over 
time,  though  the  oldest,  non-attended  chunk  is  the  one  to  be  lost  and  forgotten.  This 
proposal  is  consistent  with  those  ot  Waugh  and  Norman  (1968)  and  Newell  and  Simon 
(1972).  Reitman  (1971)  and  Shitfrm  (1972)  have  evperimentally  shown  that  loss  of 
information  from  STM  is  not  merely  a function  of  elapsed  tune.  Reitman  says: 

"Forgetting  is  produced  by  characteristics  of  the  events  of 
filled  tune,  not  by  time  itself*  (Reitman,  1971,  pl94) 

The  order  of  STM  not  only  is  the  prime  determinant  ot  chunk  loss  from  STM,  but 
also  plays  a rote  in  the  accessing  of  STM  Chunks  in  STM  are  accessed  by  an 
operation  which  sequentially  searches  (scans)  STM  for  the  first  chunk  satisfying  a 
given  condition.  Access  (attendance)  is  then  accomplished  for  that  chunk.  This  search 
traverses  STM  from  front  to  back  This  gives  front  chunks  priority,  possibly  screening 
less  recently  attended  chunks  in  STM  which  satisfy  the  same  accessing  condition.  The 
conditions  used  to  access  chunks  in  VIPS  are  defined  later  in  this  chapter  as  common 
features  of  the  three  processes  which  may  access  STM 

It  remains  only  to  discuss  the  internal  characteristics  of  an  STM  chunk  to  complete 
the  specification  of  Short  Term  Memory.  A visually-meanmgful  chunk  of  STM  is  either 
just  an  image  chunk  (as  defined  in  Chapter  1.3)  or  an  image  chunk  with  additional 
perceptual  control  information  included.  This  control  information  is  embodied  within  a 
Special  Type  element  , which  may  be  appended  to  the  head  (linear  list  level)  of  an 
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image  chunk  of  STM  (see  Figure  1V3).  There  are  four  such  Spec**)  Type  elements  used 
within  VIPS,  these  being  GOl,  COM,  LAST,  and  OGOL.  Ea^h  wll  hr,,e  re'evant  control 
properties  assoc  ated  with  it.  for  example,  the  GOL  e.ement  holds  the  name  of  the 
active  peceptuai  goal  «n  its  associated  NAME  property  A Speoa1  Type  element  «s 
p aced  at  th#  heao  of  a chunk  w.tn  special  reevance  to  the  present  perce  • ,ai  goal, 
facilitating  tha  future  access  (attendance)  of  that  chjftk.  Trough  tnese  Specal  Type 
elements  are  incorporated  direct  y into  an  image  Chun*,  their  constituency  is  not 
permanent  and  is  strictly  for  control  purposes.  These  elements  are  never  part  of  the 
final  image  representation  (perception) 

Components  Of  long  Term  Memory 

Long  term  memory  serves  the  activity  of  visual  perception  both  as  a source  of 
relevant  representational  *nowedge  and  processes  and  as  an  available  storage 
lOca*  on  tor  selected  meanmgtu  perceptual  resu'ts  The  (TM,  RlTM,  and  ITM  memor.t. 
of  VIPC  are  all  proposed  as  Deng  differing,  necessary  componer’s  of  this  multi- 
purpose long  *erm  memory  LTW  s a set  of  interrelated  pefceptuaiiy-me*ningiui 
SymbO'S  ffwTV  >S  a spec  a !y  Svucture0  component  of  long  term  memory  facilitating 
object  recogn  t.ons  and  expectations.  ITM  is  an  extension  of  STM  which  servos  as  the 
available  long  term  storage  area  for  seeded,  resu'fant  image  chunks  of  the  current 
perceotuai  activity 

4.  LTM  (Long  Tprm  Memory) 

Th#  Long  Term  Memory  of  VIPS  Ka$  no  overall  information  structure  associated 
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wtn  t.  Though  implemented  n the  program  as  • linear  list,  it  is  ideally  to  be 
cons  aer#d  as  the  set  c*  symbols  usab>a  throughout  th#  system  by  all  processes  and  in 
a I memor  es  Tnis  includes  those  symbols  introduced  m Chapler  1.3  which  defined  the 
mage  representation.  Thus,  m one  jnse  LTM  does  not  ex.st  as  a separate  entity  at 
an,  but  permeates  aH  the  other  processes  and  memories.  The  use  of  a symbol  is  an 
act  vation  of  that  element  of  LTM  (Anderson  and  Bower,  1973).  The  set  of  LTM 
symbos  does  not  change  within  t*e  course  of  on#  perceptual  tesA  performance, 
though  fheoret.caily  it  cou*d  be  altered  by  learning  processes  using  experience  over 
perfc-mances. 

The  vtsually-meanmgfui  symbols  of  LTM  are  interconnected  through  th#  placement 
of  properties  representing  spatial  and  featurai  interrelationships.  The  resulting 
nformation  structure  is  a form  of  semantic  net  (Qu*ll«ent  19€t).  The  existence  of  these 
interrelationships  affords  a valuable  means  of  indirectly  accessing  LTM  elements.  Tor 
example,  the  opposite  property  ("GPPO")  interrelates  direct, onai  symbols,  with  "(OPPO 
of  L t)n  bemg  (accessing)  PT  (See  Append  * AtTM  for  exposition  of  In#  symbols  and 
tne  assoc  ated  semantic  interrelationships ) 

5 SLIM  (Pecogn  fton  long  Term  Memory) 

Th#  recognt.on  long  term  memory  is  structured  as  a non-fana'y  (n-a'y) 
dscrmnat-on  net  with  e events  De  ng  access  b e through  traversal  from  an  in. t ai 
cement  RmM  (see  F'gufe  iv  A)  Tn.s  memory  does  not  .hang#  throughout  a 
perceptual  pn'for man< e Dy  VIPS  As  noted  with  LTM  , theoretically  it  »s  aiterabe  by 
learning  processes  Tne  bas  c nformat  on  structure,  operation,  and  possible  learn, rg 
(and  torgett  ng)  processes  of  P.TM  have  been  investigated  previously  as  £PAM 
<Fe  genbaum  and  S mon,  1964) 
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RlTM  M<  associated  with  It  ■ reference  pointer,  the  current  recognition  memory 
pointer  (CRMP).  It  i*  used  to  access  tho  memory  by  the  REC-SYS  pr Octet,  tht  Only 
pr  octet  capable  of  KCtivni  RLTM  Tht  tlemtnft  tf  RLTM  art  cal  ltd  recognition 
memory  nodes  (named  RMf*.  ■ an  integer).  RMM1  it  the  initial  node  ot  the  decision 
network,  CRMP  being  set  to  it  upon  activation  of  the  t’FC-SYS  process.  At  REC-SYS 
acquires  new  relevant  angle  feature  information  from  STIiA  CRMP  is  made  to  traverse 
RLTM  accordingly. 

There  are  two  special  propertias  (COM  and  UQX),  which  may  be  associated  with 
every  recognition  memory  node,  eidutive  of  that  node's  position  (interconnections) 
within  the  recognition  network.  Either  Or  both  of  these  special  properties  may  be 
specified  for  any  node.  If  Rf  -SYS  it  successful  in  constuctmg  a complete  obiect 
image  in  STM,  the  COM  (COMplete)  property  ot  the  last  HIT  1 node  referenced  by 
CRM?  indicates  the  name  of  that  object  COM  s specified  only  if  a name  is  known  for 
the  traversed  image  object.  If.  on  the  other  hard,  only  partial  object  information  is 
available  to  REC-SYS  in  STM,  the  UQX  property  of  the  last  node  referenced  by  CRMP 
yeids  a process  which  will  complete  the  image  ol  the  suggested,  known  object  UQX  is 
specified  only  if  a known  object  is  suggested  by  the  partial  information  in  memory. 

There  is  one  node  acting  as  a sink  node  in  RlTM  (CRMP  is  set  te  a null  value).  This 
node  is  characterized  by  its  complete  lack  of  any  anting  traversal  links  and  by  the 
absence  of  both  COM  and  UQX  properties.  The  node  is  reached  m traversal  when  the 
current  object  angle  information  found  by  REC-SYS  is  not  compatible  with  any  known 
object,  nor  is  part  of  any  known  object.  (See  Appendis  A RLTM  ter  the  definition  of 
the  RLTM  used  m the  implemented  VIPS.)  Figure  IV  4 is  a graphic  representation  of 
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image  chunk  ot  STM  (see  Figure  IV  3>,  There  are  tour  such  Special  Type  elements  used 
w.tn  n VIPS,  these  being  GOt,  COM,  LAST,  and  OGGc.  Each  » nyve  re  evant  contro. 
properhes  assnc  ated  with  it.  for  e. ample,  tne  GOL  e. ament  holds  the  name  ot  the 
active  peceotea  goal  m its  assoc  ated  NAME  property  A Spec  a!  Type  element  .s 
p aced  at  th#  head  Ot  a chunk  win  <.»cial  reevance  to  tne  cese"t  pe'te  ' ai  goal, 
facilitating  ,he  future  access  tattendancel  Of  that  chunk  Tnougn  tnese  Spec  a Type 
elements  are  incorporated  d'recty  nto  an  ,mage  chunk,  the.r  constituency  is  not 
permanent  ana  s strictly  for  control  purposes.  These  elements  are  never  part  ot  the 

final  image  representation  (perception). 

Components  of  Long  Term  Memory 

Long  term  -emory  seryes  the  activity  of  visual  perception  both  as  a source  ot 
relevant  r*prese"tat  on|i  know'eage  ana  processes  ana  as  an  ava  able  storage 
oca' on  to'  selected  meaningful  perceptua1  'esuts.  Tne  LTM,  Rl-TW,  a"d  1TM  memories 
o'  VIPS  a-e  all  proposed  as  oe-ng  dit'enng,  necessary  components  o'  this  multi- 
purpose ong  term  memory  LTM  s a set  Ot  interrelated  pe'ceptujily-mean  ngtul 
symbo  s BuTM  s a specaty  structured  component  nt  long  term  memory  tat  . tat. ng 
ob,e:‘  recogn  t.sns  ano  e«pedat.ons.  iTM  is  an  ertension  ot  STM  which  serves  as  the 
a a -abie  long  term  storage  area  ‘or  selected,  resultant  i ’*e  chunks  Ot  the  current 
perceptual  activ  ty 

A LTM  (Long  Vir  Memory) 

The  Long  Term  Memory  o'  VPS  has  no  overall  information  structure  associated 
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6 ITM  (Intermediate  Term  Memory ) 


^he  elements  of  ITM  are  copes  (from  STM)  of  se'ected  image  chunks  At  *he  time 
of  initial  VJPS  achvat  on,  PM  is  empty  set  to  a null  va-ue).  ITM  14  unbounded  m s./e 
and  growis,  witn  the  addition  of  new  e'ement  chunks,  throughout  the  perceptual 
performance  I’M  ho'-ds  the  complete  perception  (vsua.  mage)  at  the  conclusion  0» 
the  perceptual  activity  Oements  *fe  entered  into  ITM  from  STM  Dy  the  INC  $YS 
process.  Any  ;»pec>a  Type  e>ment  (,e.  GOO  is  removed  trom  » selected  chunk  pnor 
to  being  copied  mte  PM 

The  activity  Of  INC -SYS  ■$  eqjiva-ent  to  a "rehearsal"  operation  (Waugh  ana 
Norman,  1965).  Actually  V;?S  provides  two  forms  of  rehearsal  operations.  The 
temporary  means  of  chun*  attendance  maintains  an  mage  chunk  m STM  by  moving  it  to 
the  head  of  that  ordered  memory.  Th#  more  permanent  means  it  the  copying  of 
selected  chunks  into  ITM  as  performed  by  1NC-SYS 

IN  VIPS,  four  reference  posters  »fe  associated  wth  ITM  and  are  uHi/ed  by  JNC- 
^Y$  to  access  and  update  PM  contents.  R^ST-ITM  references  the  f.rst  image  chun* 
entered  into  ITM  by  the  cur'ent  perceptual  activity  lAST-ITM  references  tne  last 
churn  of  ITM  F PST -OB  ports  to  the  first  e'ement  (chunk)  m ITM  representing  an 
object  (OBJECT  type  chunk).  lAST-09  references  the  last  chunk  currently  in  ITM 
which  represents  an  ooject. 

Th.s  PM  proposal  is  m concert  with  the  "assumption  of  unreliable  STM",  wh.ch  is 
discussed  by  New'eii  (1973)  S^M,  as  .t  has  been  proposed,  s a highly  volatile, 
tr«n, ient  storage  area  It  receives  content  input  from  both  internal  memor.es  and 
processes  and  sensory-der  ed  (iconic)  scurces.  It  will  also  contain  incorrect  or 
irrelevant  debris  from  the  active  processing  of  such  inputs.  ITM  is  a cache  l*ke 
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component  of  ITM  ITM  s a read  y ac ce«s>o>e  eitens-on  of  STM,  consisting  of 
selected,  mea**  ng'ul  image  chunks  The  processes  wh-ch  can  access  STM  can  a. so 
access  ITM  by  use  of  the  *J£C0  operat  on  The  NEED  operation  extends  the  search  for 
a chan*  satisfying  a spec*t  ed  co^d  t<on  to  the  contents  o»  ITM  If  a sat<s*actorr 
is  'ogna  n ITM,  the  NEED  ooe^a’ on  transfers  a copy  to  STM  image  cngn* 
consfuct'on  or  aitera'on  is  ca"ied  out  .n  STM.  Selected  results  are  copied  to  *JM  by 
I\C-S*$  as  new  cuffent  eo*te«t  mformato* 

Hunt  (1971)  proposes  a somewhat  similar  operational  oehmton  cf  ITM  w>th 
rega'd  to  'anguage  compreHe''s<on  Me  proposes  tne  contents  of  ITM  to  oe  meanmgfj 
■ r'ormation  Vo'eru'es",  as  opposed  to  tre  "atoms"  of  S"M  In  VIPS  an  goas  and  image 
structures  must  at  some  po-nt  res  de  in  STM  in  order  to  act  ve  y influence  or  teterm  ne 
nehavior  This  d-ffers  fror  the  Hunt  pr  jpO'.a*  which  al*Ows  compie*  str  *ttu»es  in  ITM 
to  control  beha  tor 

Tre  "dual  trace"  theory  of  memory  postuates  a snort  term  memory  Which  s 
reveroeratory  in  nature  ana  a consolidated  ong  term  memory  trace  which  s stabe 
ana  constructed  as  an  effect  of  tne  reverberatory  activity  This  theory  has  been 
accomodated  to  become  a "muiti-trace"  theory  as  investigations  into  tne  effects  of 
elecfroconvui  ive  shot",  and  .erta>n  drugs  upon  memory  consolidation  indicate  tne 
probaolt  t<  stmce  of  an  intermediate  ho  ong  stage  between  the  two  e«tremes  o ' the 
dual  trace  theory  (See  John,  *971) 

WiCfceigren  (197?)  de*eop'  a muiti-Uace  theory  ot  memory  based  on  the 
a'cess-b'  >ty  (strength)  decay  0*  nformahon  w th  elapsed  time  Trough  e apsed  time  it 
not  a 'actor  m the  definition  of  VIPS  memnry  components,  an  ITM  w>fh  a time  factor  of 
severa-  minutes,  as  »s  proposed  by  Mdieigren,  is  consistent  with  the  time 


requirements  toi  information  maintenance  which  mod  bo  imposed  upon  the  ITM  Of 
VIPS  to  eiplam  the  observed  behavior 

THE  PROCESSES 

Each  of  Ih#  constituent  p-ocesses  of  VIPS  tAA-SYS,  REC-SYS,  1NC-SYS,  VI-SYS)  is 
det  ned  m the  form  of  a production  system,  a means  of  cognitive  psychological 
modeling,  which  is  adequately  defined,  discussed,  and  llustrated  elsewhere  (Newell  and 
Sunon,  197?;  Newell,  1973)  A production  system  is  comprised  of  an  ordered,  tmitn  set 
of  production  rules,  each  having  a condition  halt  and  an  acton  half.  W lh  each  system 
operation  cycle,  the  Ordered  set  ot  ru'es  of  the  currently  active  process  is  searched 
according  to  the  defined  order  unM  a production  rule  is  found  whose  condition  halt  it 
fully  satisfied  by  the  current  state  ot  the  relevant  memory  (memories).  That  rut#  is 
then  sa<d  to  f re,  the  operations  of  the  rule's  action  ha'I  are  e>ecuted  in  light  of  the 
memory  information  accessed  during  satisfaction  ot  the  ru'e's  condition  half  The 
necessary  functions  which  serve  to  imbed  the  production  system  control  structure  Of 
VIPS  processes  within  LISP  1®  a'e  those  implemented  by  Moran  (1973)  for  his  VIS 
system.  STM  management  is  a'so  done  by  utility  functions  defined  by  Moran 

The  proposed  processes  a>e  distinguished  by  several  definitional  criteria,  these 
being: 

1.  the  memories  referenced  and  operations  employed  in  the 
condition  halves  ot  the  constituent  ru'es; 

2.  the  memor  es  referenced  end  oper ebons  employed  in  the  action 
halves  Ol  the  constituent  rules; 

3 the  degree  ol  process  similarity  between  subjects. 
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On#  outstanding  operational  difference  b*tw**n  prKHHt  K that  of  ( ptocMl' 
role  m th*  VIFi  t /cl*  of  operation.  AA-SYS  (IK*  assimilation  • accomodation  procats) 
it  considered  to  b*  th*  main  proc*st  and  all  thr**  cth*fi  art  tuppl»m*nt*ry 
processes  AA-‘YS  it  th*  procatt  initially  activated,  bringing  lit*  to  VIPS.  It  can 
subsequently  ac<  vat*  any  of  the  other  thr**  tuppl*m*ntary  proc*tt*t,  which  upon 
their  deactive' .on  yield  control  again  to  AA-SVS  (t**  Figure  IV.S).  Upon  perception 
coir.jiletion  A A SYS  it  deactivated,  killing  VIPS  itself 

To  initiate  th*  usual  cyclic  court*  of  VIPS  activity,  AA-SYS  loads  th*  visual 
register  according  to  currant  STM  contents  and  then  activates  VI-SYS.  Tt.it  it 
effectively  a request  for  new  visual  input  VI-SYS  references  th*  *>1*rn*l  Picture 
memdry(PIC).  altert  th*  visual  register  accordingly,  and  deactivates,  returning  control 
to  AA-SYS  AA-SYS  considers  th*  resultant  Visual  Register  cell  contents  in  light  of 
urrent,  relevant  $TM  image  chunks  Either  the  new  information  can  be  consistently 
assimilated  mtr  STM  or  the  image  contents  must  be  accomodated  to  rea'ue  th* 
incorporation  of  the  new  input  AA-SYS  mev  activate  REC-SYS  to  perform  object 
recognition  or  1NC-SYS  to  incorporate  se'ected  STM  chunks  into  ITU  It  then  reloads 
the  Visual  Register  and  again  activates  VI  SYS  This  continues  until  a satisfactory 
perception  has  been  constructed  as  a visual  image  m ITU 

1.  VI-SYS  (Visual  Input  Process) 

The  VI-SYS  process  has  several  distinguishing  characteristics.  Th*  most  notable  Of 
these  is  that  it  is  proposed  to  be  erectly  th*  same  for  *11  sublets.  This  is  th* 
consequent  of  several  factors  the  mam  one  being  a result  of  a stated  goal  of  this 
thesis  This  goal  is  the  development  of  image  elements  and  structures  capable  ot 
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repreien*  a $ub,ects*  comp  ete  a"a  ntermea.*:#  iparf.a  > <ne  dra*.ng  percept  ons 
Furthermore,  the  list  of  visual  features  obta-naaie  a!  a .eMe*  by  tne  eyes  s 
cons  dered  to  be  aeM  »o  r a s ’s  *C'  t re  gven  nc  d'a*mg  en,  ronmen! 

Another  factor  w^tc*  eads  to  <?s  unique  un.form  definition  s tne  process’  access 
o*  0 / tne  V s^a  sfe*  ana  P ;tu»e  memor  es  o„r,ng  act  at  on  Tre  process  <s  tnus 
oe.y  ^o  -ect  i ejected  by  a*,  active  perceptua  goas,  *n.ch  are  me  wj.n  source  of 
sub, ect  be^avio”  deferences.  use  to  vkh.cn  tne  process  .s  put  may  and  does  vary, 
but  its  def.n  ? on  aoes  not 

Vi-sts  ‘S  a so  spec*'  n tnat  it  s tre  only  process  *«tn  access  to  tne  Picture 
memory  "hys,  tne  Visual  inp^t  process  is  tne  on.y  interface  oeUeen  tne  en^.rcnment 
(external  visual  reformation  of  P*C)  and  an  interna,  memory  tV.suai  Pcgs!er'  ot  tne 
proposed  perceptual  system  re  process  s not  drectl/  ana'ogous  to  the  rjman  e,e, 
though.  Pa?ner,  VI  SYS  $ a como. ra'  o ot  tne  motor  process  contra. 'ing  eye  mo  e) 
movements  and  t*e  process  *n.ch  operates  upon  the  eye-produced  feature 
nformat  on  to  produce  (construct)  th#  visual  iCOh. 

Process  Similar. t-es 

"he  rules  of  the  otner  three  processes  an  reference  STM  m the.r  condition  ha  ves, 
and  are  all  primarily  dependent  upon  the  name  of  th#  current  goal  for  Determination  of 
the  rule  to  be  fired  Thus  ail  ru'es,  but  lor  a fe*  special  exceptions,  start  with  two 
bas*c  operations  *n  the«r  condition  halves,  these  be-ng  "(el:  GOl)-  (or  "(el  GOL  HD 
and  "((NAME  OF  GOL)  • **)".  Th#  “(•;:  GOl)"  condition  operation  accesses  the  STM 
chunk  to  which  the  Special  Type  element  GOl  has  been  appended.  The  local  (to  the 
rule)  variable  is  assigned  tn.e  accessed  chunk  as  its  value  (when  the  variable  "II" 


/ 


✓ 


* — -- 


I 

i 


i$  added,  *11"  is  locally  assigned  the  value  of  the  Chunk  Header  element  of  the 
accessed  chunk).  Tne  "((NAME  OF  GOO***)"  operation  determines  it  th.s  rule  is  to  be 
♦•red  m association  with  the  current  goal  (e  g.  *t  the  name  of  the  current  goal  is  n)  It 
these  two  condition  operations  are  satisfied,  the  further  condition  operations  of  that 
rule  are  sequentially  app  eo  to  STM  for  possible  satisfaction.  Such  ru'e  definition 
creates  a valuable  parftt  on.ng  of  the  rules  of  a process  (by  goals),  expediting  both 
system  operation  and  rule  detm.t.on 

A second  similarity  is  the  means  0/  wh.ch  these  processes  gam  access  (give 
attention)  to  the  chunks  of  information  m STM.  Tne  rules  of  these  processes  achieve 
this  access  >n  only  two  basic  ways  One  means  of  access  has  been  illustrated  above 
by  tne  "(•!  GOD"  cond.t-on  operation.  This  means  of  chunk  accessing  depends  upon 
the  existence  of  a Special  Type  e'tmtnt  (>e.  GOD  which  has  previously  been 
appended  to  the  appropriate  chunk.  This  *s  pre  determ.ned  (premeditated)  attendance 
of  a chunk  wh.ch  is  re'evant  to  the  current  perceptual  gcai 

The  other  means  of  attenomg  to  a chunk  .n  ^TM  >s  through  the  use  the  "(ai:  t! 
<MA$  •»■»))•  fondT.on  operation,  I be  --g  an  integer  The  "(at-  SI  <HA$  **))"  operation 
locates  and  at*»"ds  to  the  t.rst  S*M  chunk,  if  any,  wn«ch  contains  the  element  '"t  with.n 
its  image  body  structure  The  accessing  operation  only  must  consider  the  chunks  of 
bTM  at  the  top  (imear  list)  level  to  determine  simple  element  containment  A 
successful  search  results  m the  :oca<  bind-ng  of  *■!:"  to  the  accessed  chunk  and  "SI"  to 
the  Chunk  Header  e'ement  of  that  chj*»k.  Tne  "(Tt  D el:  (HAS  ??))*  condition  operation 
extends  the  search  for  the  dev  chunk  to  ITM.  The  operation  automatically 
establishes  a copy  of  the  accessed  cnun*  at  th#  head  o'  TM  (if  found)  and  tocally 
binds  the  and  "II*  variables  as  noted  above. 
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This  accessing  of  chunks  by  either  image  element  containment  or  Special  Typo 
e'ement  appendment  again  greatly  improves  system  operation  and  definition  m terms 
of  speed  and  simplicity.  The  attendance  of  a chunk  is  achieved  without  encountering 
the  comple*  semantic  structure  being  represented  in  the  image  body.  As  noted,  there 
is  no  attempted  syntactic  matching  of  any  element  sequences  at  the  linear  fist  level 
and  no  attempted  schema  matching  to  the  whole  or  any  part  of  the  image  body 
structure  to  accomplish  chunk  access.  The  definition  of  the  symbol >c  elements  of  tne 
image  chunk  as  property  groups  which  embody  the  meaning  make  this  possible. 

Process  Control  Structure 

The  position  of  current  goal  as  the  primary  determinant  of  rule  firing  implies  • 
definite  control  structure  for  these  production  systems  and  thus  for  the  cognitive 
processes  they  represent  Upon  each  system  cycle,  the  GOl-appended  chunk  is  first 
attended,  and  the  name  of  the  current  goal  (NAME  OF  GOD  is  matched.  Any  further 
relevant  chunks  are  then  attended.  Chunk  attendance  does  not  involve  consideration 
of  the  chunk’s  informational  content.  Finally,  conditions  based  upon  the  information  of 
the  accessed  chunks  (and  the  sensory  register,  if  perception)  ere  evaluated  and  a rule 
fires  producing  the  "desired"  activity 

The  current  goal  is  an  internal  (internally-derived)  state  which  influences  the 
perceptual  activity  of  VIPS  in  three  basic  ways.  It  first  determines  what  of  the 
available  information  is  to  be  attended  during  a system  cycle.  Secondly,  by 
partitioning  the  rules  it  determines  the  class  of  actions  possible  during  a system  cycle. 
Finally,  by  determining  actions  it  influences  the  final  representation  (perception)  which 


is  realized. 
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2.  AA-SYS  (Assimilation  - Accomoaat  on  Proctss) 

P-aget  (1967,  1 9^0)  ►'as  defined  ana  c scussed  *ne  fundamental  assimilation 
accomodation  act  ty  of  an/  living  system  wncn  nte-acts  w th  its  environment.  The 
activity  of  visual  perception  is  a pr.mary  e»ampe  o‘  Such  interaction.  In  the 
interaction,  the  system  must 

N ’assimilate'  tne  eternal  *ofld  into  the  structures  that  nave 
already  been  const  uctca  and  second. y to  reaa,ust  these 
structures  as  a function  of  subtle  transformations,  ,e  to 
’accomodate*  tnem  to  external  objects"  (P  aget,  1967,  p8> 

The  assim«iat-on-accomoaat«on  process  s tne  only  process  with  access  to  both  the 
newly  acquired  visual  information,  found  m the  V.sua  Pegstef,  and  tne  image  memory 
Currently  <n  STM.  Given  trvs  new  visual  mformat-on,  the  task  of  AA-SYS  s either  to 
assimilate  it  into  tne  current  image  m STM  or  to  accomodate  this  current  -mage  to 
acccmpiisn  integration  Ot  new  :or't  :t.ng  v'-ua-  information  The  rew  informs*  on  may 
be  r>  -mi  ated  b/  cn'i-i  ng  the  contents  of  VI  mis  $*M  as  a new  image  chunk  Th.s 
involves  the  linking  of  tne  -con'C  image  to  the  current  mage  of  STM  b>  crea*  "g 
approp-  ate  spat  a or  equ-v  a-enc , re>at>0**  The  ass-m  lat.on  ma,  be  accompi  shed  o, 
just  mar«.  ng  appropriate  events  of  an  ensting  th/potneSijed?  -mage  cnu"*.  as  be  ng 
conf  rmed  T-na'iy,  assim  lat  on  may  -nvOive  no  action  UPO’  tne  e*  St  ng  STM  contents 
When  e*pectations  concerning  the  rew  v-sua1  input  are  not  *u't  'ed,  the  mage  memo*  y 
of  STM  must  be  accomodated  to  ach-eve  consistency  w«tn  th.s  input  Such  e»Dec:atO"s 
derive  from  a b/potnes'?ed  oo,ec!  mage  , ,rom  a prevtouslv  constructed  mage  chunk 
thoujh!  to  represent  tne  pa't  of  v-sua  ♦•«»<!  currently  fita'ti,  or  from  otner 
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pcss  b e perceptual  inferences  The  source  of  the  incorrect  expectation  must  be 
* *ered  of  another  e**stmg  cons-stent  image  chunk  must  be  found  to  accomodate  STM 
to  the  conflicting  mput.  PEC-SYS  and  INC-$Y$  may  be  appropriately  activated  by  AA- 
SYS  »o  accomplish  ts  task. 

AA  SYS  s the  most  n.gh^y  variable  process  between  subjects.  It  «s  here  tnat  the 
subject's  pe-ceotua1  strategies  are  pr  manly  represented  A strategy  is  defined  by  a 
set  of  ooss  oie  goals,  tKe  doss  o’e  trj^s  t-ons  between  th«  goals,  and  tne  conditions 
associated  with  each  pos  ibe  trantito*  AA-SYS  is  the  generator  of  most  active 
te'ceptua  goa  s to*  the*r  transit  ons),  and  as  such,  >s  tne  primary  embodiment  of 
stategy.  Two  genera  strateges  nave  been  inferred  to  account  for  the  observed 
subjects’  behavior,  and  ae  discussed  n Chapter  II  I 

3.  RtC-SYS  (RECogn.t'On  Process) 

When  tne  recognition  process  $ activated  by  AA-SYS,  it  w«H  proceed  to  access  and 
traverse  various  reevant  image  chunks  o*  snort  term  memory  Based  upon  tne  image 
"‘O'mat  on  encountered,  t^e  process  t a.erses  tne  Current  recognition  memory 
do  n*er  (CPVP)  tn-ougn  PltM  It  simultaneous  y constructs  a partial  or  complete 
ob(e,t  -mage  as  poss  be  JpO"  vomperon  o*  tn,s  mage  tra.ersal  an  object  name,  a 
«,no#.n  oo;ect  goa,  or  that  nsuif.-i  nformaton  s ava^abte  fpr  either  will  be 
decided  by  t^e  process,  acco'j^g  to  l^e  COM  or  uQX  property  of  the  recognition 
memory  node  fma  y referenreb  o»  CPMP 

rhe  basic  operat  o^s  *n  n t'a.e'se  tne  mage  and  R^’M  oo  not  vary  with  distinct 
subjects,  due  to  tne  fact  tnat  tne  image  structures  employed  Dy  all  subjects  are  the 
same  "h©  rule  w*th  tne  correct  memory  traversing  operation  action  part  is 
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determined  by  the  condition  pert  based  upon  the  type  Ot  image  structure  the  currently 
acceded  chunk  embodies,  the  type  ot  image  element  referenced  witmn  that  image 
chunk,  and  the  current  perceptual  goal  (prospected  by  AA-SYS).  The  depedence  of 
rule  firing  upon  a current  goal  result*  m PEC-SI'S  varying  between  subjects.  The 
regularity  ot  image  body  and  RlTM  structures  between  subjects  restricts  this 
variability  to  a level  below  tnat  ot  AA-SYS. 

4.  It aC -SYS  (IfrCO'ponliOn  Process! 

When  the  incorporation  process  is  activated  by  AA-SYS.  its  task  is  to  enter  copies 
ot  the  appropriate  image  chunks  into  |TM,  eliminating  any  outdated  version  ot  the  same 
image  structure  that  may  ea  st  in  ITM.  It  is  the  only  process  which  may  alter  the 
contents  0*  ITM.  (Whether  a copy  should  be  made  or  only  a referencing  pointer 
established  to  the  chunk  is  not  dear).  This  process  may  also  be  activated  to  improve 
upon  an  emsting  ITM  representation.  This  may  involve  the  ree*i!at>on  ot  a more 
concise  image  or  an  attempt  to  eliminate  possible  inconsistencies.  These  functions  are 
discussed  further  in  the  ne«t  chapter. 

The  basic  operations  tor  copying  image  chunks  into  ITM  do  not  change  with 
differing  subjects  With  differing  perceptual  strategies,  different  image  chunk  types  will 
be  marked  tor  incorporation,  though.  Thus,  similar  to  PEC-SYS.  INC-SYS  has  some 
limited  variance  between  subject  models. 
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2.  The  System  in  Action 
A PROTOCOL  - PROGRAM  TRACE  SEQUENCE 

The  rest  ot  the  chapter  presents  en  illustrative  eiample  ot  VIPS  in  operation.  This 
eiample  corresponds  to  the  initial  protocol  segment  ot  Figure  11.14.  The  eiample 
illustrates  not  only  system  operation  but  also  features  of  protocol  ■ program 
correspondence 

Figure  IV  4 presents  the  too  initial  protocol  frames,  VI  and  V2.  Figure  IV.  7 shows 
the  complete  lino  drawing  Stimulus  involved  With  the  vertei  numbering  convention  that 
is  m use.  Frame  VI  indicates  that  vertei  number  1 is  initially  in  view,  that  being  the 
right  angle  vertei  m Ihe  lower  left  ot  the  line  drawing.  The  subiect  considers  this 
available  visual  information  and  indicates  by  statement  [S3]  that  it  is  sufficient  to 
suggest  (hypothesise)  a square.  By  statements  [$4}  [SSI  and  [St],  the  subject 
indicates  the  involvement  of  this  object  hypothesis  m the  subsequent  hole  movement 
activity  ot  frame  V2 

Figure  IVJ  presents  the  initial  segment  of  the  corresponding  trace  Of  VIPS 
activity.  VIPS  is  activated  by  an  asternal  activation  of  the  AA-STS  process  a* 
indicated  by  Ihe  first  line  ot  the  trace.  Initially  STM  consists  Ot  nine  empty  cat  s as 
indicated  by  the  tine  labelled  by  *0 O'  This  number  is  the  system  cycle  number.  It  is 
used  to  label  STM  listings  and  will  be  underlined  m the  trace  segments.  Upon  this 
initial  activation,  rule  RAAOO  fires  which  activates  VI-SVS  to  obtain  the  fi'St  view  of 
the  line  drawing  (from  PIC).  In  VIPS,  the  initial  goal  is  NIL 
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Rule  VII  of  VI-SYS  fires  and  constructs  th*  initial  iconic  image  in  VI  in  accordance 
with  Visual  Register  and  CPP  values  sot  prior  to  VIPS  activation.  Figure  IV  9 is  a 
schematic  pictorial  representation  of  the  varies  image  (labeled  by  the  Chuns  Header 
element  V3)  which  VI -SYS  develops  m VI.  As  indicated  by  the  STM  listing  *2,0',  STM  is 
not  affected  by  VI-SYS  activity. 

Upon  VI-SYS  deactivation,  control  is  returned  lo  AA  SYS  and  rule  RAAO  fires.  This 
rule  'sees*  the  first  vie*  row  in  the  V!  cell  and  transfers  Inis  information  to  STM  as  a 
new  image  chunk.  Th*  rule  also  appends  the  Special  type  element  LAST  to  this  chunk 
and  creates  another  STM  churn  which  consists  so'ely  of  th*  Special  type  element  GOL 
(see  -3.0*). 

Two  general  perceptual  stategies  have  been  inferred  from  the  available  protocol 
data  This  has  resulted  in  the  implementation  of  two  corresponding  versions  of  AA- 
SYS  (see  Chapter  II 21  The  strategy  currently  under  discussion  is  that  successively 
recognizing  objects  until  completely  representing  (percievmg)  the  line  drawing.  As 
such,  th*  active  goal,  "(NAME  OF  GOL)*,  'S  set  to  PNO  and  REC-SYS  is  activated  (ACT 
•91 

Prior  to  a REC-SYS  activation  “nth  goal  RNO,  one  chunk  is  always  marked  by  the 
element  LAST  to  indicate  the  first  image  chunk  to  be  traversed  by  REC-SYS  A chunk 
is  also  always  created  containing  only  the  element  GOL  That  chunk  is  the  site  of  th* 
construction  ol  the  new  objc  ' image 

Rule  PECO  (of  REC-SYS)  fires,  initially  setting  CRMP  to  RV.  1 The  rule  traverses 
the  right  angle  of  th*  vertev  chunk  V3  and  accordingly  sets  CRMP  lo  RMN2  (see  Figure 
IV.d).  Furthermore,  th*  process  begins  consluchon  of  an  object  image  (010)  in  the 
GOL  - appended  chunk  (see  "4,0*>.  Figure  IV.IO  iilustates  this  partial  object  image. 
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W*en  tr»e  actve  go*  '«  t *0  spec-a  p'optrt-es  are  associated  w*th  tne  COL 
e'ement  Trese  are  Li*.*'  and  POIP  (Prime  Divert  o»*  l!\<  re^'-nces  an  image  bod> 

r ement  ct  a ree**nt  .mage  cnu"*  Tn.s  e r*r!  «s  t*#  beg  n*vng  po<nt  for  irrag.e 
traversal  o>  P£C-S>S  dur.ng  4 system  cyce  Wen  *o  further  image  chunks  e«.st  <>n 
S'M  or  ;TM>  wn-cn  are  »ee*an!  to  Ine  Cu^e^t  oo,ect  recogmt.cn,  U\K  of  GOL  is  set  to 
LXJX  The  PQiP  property  ot  GOL  -rotates  tne  a-'ect.on  (perpeno’cuia*  to  t^e  tra\crsa> 
o-rec  t on  *•'  cn  >s  "pe'ce  sed"  as  rr  »o  ^e  ns>de  of  t*e  object  *ne  effect  ot  PCIP 
ukiO»-  P£C-S>S  j-.y  t,  >s  ff,"  fr! v o*  * gufe  g'Ouna  judgements  >’JIP  guoes 
lMe  tra»e^sa.  o*  mage  c u^-s  a~u  cetera. nes  *h'Ch  encountered  *ea!j'es  Ung.es)  are 
«ntef  jr  to  *ht>  ou  ect  and  reeunt  to  <ts  recogrvt.on. 

> ‘he  present  case,  Pi  CO  sets  c IV  o*  GOu  to  UjX  as  tne  verte*  chunk  iV3)  >s  tne 
on  > l*eesant)  mjge  -ntormat  on  ava  abe  ?0\9  >%  n.tia  «y  set  eitemat'v  but  a 
s,,osequent  va'ucs  are  determ  -eo  d>  VIPS  S rce  l IV  ot  GOL  »s  tQx,  ru»e  PECl  t.res 
tor  t~e  ne«t  system  cyc’e  Tne  L<?X  property  o*  PM\2  (current  CPMP  value)  > e'ds  th# 
p'ocess  SPi  wn.cn  co-'pe’es  t^e  nyC,o?ne*'7ed  .n»ge  ot  a saua'f-or-r,  targe  Tr-s 
s .nd'Cateo  Oy  S’M  «t ng  -.0"  a^o  ustu’ea  by  : g re  IV  * 1 *P  rj*  sets  tne 
Cu'rerf  g0l|i  to  S*0?  (Start  *nc*r  Object  2 qme**s*onat.  PEC-$¥S  deactivates  a^d 
( o nt # o aga  n returns  to  AA  $v$  f -gure  IV  12) 

P-  e S«*02 1 'ot  AA  -SV$>  4 res.  c-a^g  rg  the  goa1  to  *Q2  and  toad  ng  tre  EXP,  Ar  T, 
a'-a  O.'P  ce  s of  t»a  V sue  Peg  ster  a ;n  va!ues  ta*e*  from  :*e  ob,ect  "age  010  see 
* gure  IV  12)  Tnese  .a  ues  a'e  ootanea  o,  use  o*  '.**  CP  property  o’  GOt  CP 
Currently  'e’erences  "“age  oody  e f^pr*  Hi  <toe  !VEP\At),  DIP  >s  set  to  t^e  va  ue 
of  **-e  01'  property  of  ii  * A*"  - <e*  to  t^e  »a  ue  o*  tre  OlVi  p'Ope't / o»  li  i ExP 

s s?t  to  tne  va  ue  of  tne  A Vi  proper!*'  of  Ai5,  «n.  cn  .s  (A\3  of  (ATT  ot  ulx  of  li  1)‘). 


Figur*  IV  12 


A . I >5 

**v  S S-CVI  S'A»T  t-Cv*.r#IT  s 3P  ■',’*'.%*•  09j£CT  l\FO 
..3  V.  _.VS 

3.  \:<>  >«••.*•  .<  \o  s"a;:-'  s;3ts  rouso 


dip  :s  =* 

p.'.*i  is  '.':l 
(.»•’  ;s  -’A 

ATT  IS  UP 
VI  IS  Ml 
A*  Y*P*:  » VSP3 
Dip  IS  »r 

PA*#  IS  lO 
€»p  IS  *.0 

A”  :s  Figure  IV.  13 

VI  IS  V24  P2b  X?6  A31  X30  A29  X2S  A27) 


/ 


/ 
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If 

In  the  generalised  rut*  specification,  111  it  (CR  of  GOU  The  rut*  than  activates  VI- 
SVS  (ACT  *231 

Figure  IV  13  returns  to  the  nest  segment  ot  the  transcribed  protocol.  The  subject 
reaches  vertea  number  3 at  protocol  frame  V3  Ha  notes,  by  statement  [S7J,  a 
discrepancy  between  eapectstions  and  the  new  visual  information.  The  acute  angle, 
teen  at  interior  to  the  “ gure*,  causes  the  subject  to  accomodate  the  previously 
hypothesised  object  (ipuare -or -rectangle)  image.  Tha  new  information  lead*  the 
subject  to  now  hypothesis*  a triangle,  at  mowed  by  stat*m*nts[SI]  and  [Sfj  The 
subject  moves  th*  hoi*  te  begin  confirmation  ol  this  new  object  image  (statement 
[S10]).  The  subject  moves  through  vertes  number  I (frame  VB)  without  hesitation. 

Corresponding ly,  Vl-SYS  rule  VI*  fires,  which  -ets  CPP  to  th*  vertea  description 
list  ot  vertea  number  three  (VETO  of  Appendia  A.PIC).  Th*  rum  then  alters  th*  visual 
register  accordingly  (tee  Figure  IV.14).  VI  cent  amt  th*  image  representation  ol  th* 
now  vertes,  which  it  illustrated  by  Figure  IV.ll  CXP  is  set  te  NO  at  the  angle  feature 
ACA  differs  from  the  eapectod  RTA  value.  EXP  it  set  by  the  pre-attentive  function 
CAX  which  is  applied  by  rule  VI*  ef  VI-SYt  Vl-SYS  da  activates  and  control  return* 
again  te  AA-SYS. 

Rule  K024  (of  AA-SYS)  fires  at  a result  of  th*  NO  value  of  EXP.  K024 
accomodates  the  object  image  chunk  010  m accordance  with  th*  image  of  VL  Image 
body  elements  117,  All,  II*,  120,  A21,  and  122  are  removed  from  th*  chunk.  Th* 
element t A1B  and  II*  are  altered  to  correctly  embody  th*  iconic  input  in  VL  Th*  ANG 
property  of  A19  it  changed  te  ACA  and  th*  OK  and  (XV 1 properties  of  11*  are 
changed  te  UL  end  OL  respectively.  This  action  it  indicated  by  STM  listing  tfim  and 
illustrated  by  Figure  IV.1S.  The  Position  type  element,  P29,  it  added  to  the  object 
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Figure  IV.  14 


GOAL 'IS  K02 

7.0  STM;  (GOL  OIWNAME  SQUARE -OR  RECTANGLE  DIM  TWO  TYPE  00  JE- 

CTKP4  111  A12  113  114  A15I16  117  A13  119  120  A21  122)  ) 

(V3(CR  XS  PNUM  P4  VSPEC  (RTA  OD  SPEC  V2  TYPE  VERTEXXP4  X5  A8* 
X7  A6)  ) 

()<)()  0 0 0 0 

ACT  *1:  AA-SYS 

RULE  K024:  VI  IS  NOT  AS  GOAL  REQUIRES. 

GOAL  IS;  RKI 

8.0  STM;  <V24(CR  X26  PNUM  P25  VSPEC  (RL  UL>  SPEC  TE  TYPE  VERTEX)* 

(P25  X26  A31  X30  A29  X28  A27)  ) 

(GOL  OKXWME  SQUARE-OR-RtCT ANGLE  01M  TWO  TYPE  O0JECTXP4  - 
111  A12U3I14AI5I16P25)  ) 

(V3(CR  X5  PNUM  P4  VSPEC  (RTA  OL)  SPEC  V2  TYPE  VERTEXXP4  X5  AS- 
X7  A6)  > 

000 000 

ACT  .32:  REC-SVS. 

RULE  RKll:  A KNOWN  GOAL  INTERRUPT  CAUSES  RE-RECOGNITION. 

GOAL-IS:  SK02 


9,0  STM:  (GOL  010INAME  TRIANGLE  DIM  TWO  TYPE  0BJECTXP4  111  * 
AI2  113  114  A15  lit  P29  133  A34  139)  ) 

(V24(CR  X26  PNUM  P25  VSPEC  (RL  UL)  SPEC  TE  TYPE  VERTEXXP25  X2* 
6 A3 1 X30  A29X28A27)  ) 

(V3(CR  X5  PNUM  P4  VSPEC  (RTA  OL)  SPEC  V2  TYPE  VERTEXXP4  X9  At* 
X7  A6)  > 

000000 

ACT  *1:  AA-SYS. 

RULE  SKQ21:  START  LOOKING  FOR  KNOWN  OBJECT  INFO 


DIR  IS  UL 
RAN  IS  Ni1 
EXP  IS  ACA 
ATT  IS  OL 


VI  IS  Nil 
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chunk,  assoc  atea  with  the  a tered  "comer"  The  vertex  mage,  V24,  is  entered  into 
STM  from  VI.  The  image  body  elements  A 15  (of  OiO)  and  A27  (of  V24)  are  linked  by 
equ  valence  property  KEA  (Known  EQu-»a  ent  ANGlE). 

Furthermore,  ru*e  K024  changes  the  current  goal  to  RKl  (Rerecogn  ze,  Known 
in1  erupted),  sets  CR  of  GOl  to  Ii6,  and  activates  REC-SVS  to  ad  in  age 
accomodation.  W.th  rule  RKl,  rule  RKIl  (of  REC-$Y$>  fires.  This  rule  first  sets  C«N/P  to 
RMN1  The  rule  then  traverses  the  partial  ob  ect  .mage  of  the  GOl  appended  chun*. 
(010)  commencing  at  116  (CR  of  GOD  CRM?  according  y i.  moved  through  the 
discrimination  net  of  RiTM.  In  tn.s  case,  RV\3  s the  node  referenced  b,  CRMP  The 
associated  UQX  property  yields  tne  process  TR3  *h,cn  f.msnes  a n.potne  zed  tnang.e 
•mage  This  »s  »nd  cated  by  5TM  "9,0"  (Figure  IV  14)  a^d  s illustrated  by  F gvj'o  IV.  1 7 
S-nee  a known  object  is  again  suggested,  REC-SYS  sets  the  goal  to  $K02  and 
deactivates. 

Ru'e  $<021  (of  AA  SYS)  f.res,  sett  rg  V.sua  Register  a'ues  according  to  the 
accomodated  Object  (t'<ang>e)  .mage  as  descr  bed  aoo  ve,  chang. ng  tne  goal  to  K02,  and 
act. vat  ng  VI-SYS  The  trace  of  F gyre  IV  18  vacates  t**at  rue  V(3  t res  as  a result  of 
the  straight  a"g  e on  the  ATT  s.ge  0f  verte«  number  8 V!-$YS  cont  nues  to  mo/e  CPP 
in  the  DIR  d'ect-on,  reaching  *er*e«  number  2 Ru'e  VI 1 1 fires,  wh.cn  completes  the 
iconic  image  n VI  that  is  illustrated  by  Figure  IV  19  EXP  >s  set  to  CON,  which  nd. cates 
that  the  e«pe  ted  an^ie  feature  was  found  but  »s  part  of  a complex  verte*  (more  than 
2 e»d  d-recl.  »s / A QUlC<$tE  eemenf  (Q43)  is  used  to  represent  vertex  8 m the 
iconic  line  .mage 

F gure  IV  20  returns  agam  to  the  next  segment  of  protocol.  The  subject  also 
reaches  vertex  2 as  a result  of  the  hole  movement  He  indicates  expect?** ' 
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Figure  IV.ll 


ACT  «3S:  VI-SYS. 

PULE  VI8:  ATT  t EXP  SPECIFIED  ANO  STRAIGHT  ATT  SIDE. 

AT  VERTEX  VER8. 

MOVE  THROUGH  VERS. 

RULE  VIU : EXP  • ATT  * END  OF  LINE. 

AT  VERTEX  VER2. 

OIR  IS  UL 
RAN  IS  LS 
EXP  IS  CON 
ATT  IS  DL 

53  P49  EM  140  141  Q43  '4i>  139  146  E47  V48  P49  X50  A55  X54  A- 


Fljure  IV.lt 
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Fifura  IV.  20 


and  thl*  It  tha  third  tldt  (Sll] 


ACT  *1:  AA-SVS. 


Figure  IV.21 


RULE  K028:  EXP  IS  PART  OF  VERTEX  WITH  S10E. 

GOAL -IS:  K02 

1 4.0  STM:  (V48(CR  X52  PNUM  P49  VSPEC  (UO  DR)  SPEC  TE  TYPE  VERTEX  >* 

(P49  X50  A55  X54  A53  X52  A51)  ) 

(L37ICP  VSPEC  DIAGONAL  TYPE  SIDEXP49  P25  P42  P49  E38  IA3  * 
141  Q43  144  145  E47)  ) 

(GOL  OlOtNAME  TRIANGLE  DIM  TWO  TYPE  O0JECTXP4  III  AI2  113* 
114  A15  116  P2S  133  A34  135  P49)  ) 

(V24(CR  X26  PNUM  P25  VSPEC  <RL  a)  SPEC  TE  TYPE  VERTEX)...  ) 

(V3(CR  X5  PNUM  P4  VSPEC  (RTA  OL)  SPEC  V2  TYPE  VERTEX).  ) 

0 0 0 0 

DIR  IS  DO 
RAN  IS  NIL 
EXP  IS  RTA 
ATT  IS  RT 
VI  IS  NIL 

ACT  *56:  VI-SYS. 

RULE  V19:  EXP  • ATT  * NO  STRAIGHT  SUES  EOLfCL 


/ 
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satisfaction  and  continuation  of  th#  currant  goal  (and  object  hypotnes>s)  by  statement 

[Sill 

Figure  IV.21  presents  tQyva'tnt  activity  in  th«  tract  ol  VIPS  Pul*  <028  (Ol  AA- 
SVS)  tire*  du*  to  In*  COM  (CONtemed)  value  Ol  EVP  *nd  the  LIME  type  ol  the  iconic 
image  Ol  VI.  The  ful*  splits  the  .mage  ol  VI  into  two  parts,  vertes  V48  »nd  he  .37 
Tho  v#rte«  image  is  entered  into  STM  Th,s  I indicated  By  STM  luting  "14, 0"  and 
illustrated  by  Figure  IV  22  Image  Body  elements  A34  (o*  010)  and  A5I  tot  VA8)  being 
linked  by  the  XEA  equivalency  property.  *ne  hne  image  IL37)  t changed  into  a SIDE 
typ*  image  chunk  and  entered  mto  STM  Ise*  '14,0"  and  Figure  IV 23)  Tn*  END 
elements  E38  and  £47  are  nued  to  INTERNA;,  elements  116  and  133  ol  010 
respectively  Position  type  eement  P49  is  incorporated  mto  010,  assooa'ed  w.tn  the 
“corner"  ol  133,  A34,  and  135  Finally,  the  rule  updates  CR  ol  GOL.  to  reference  135 
and  loads  tn*  Visual  Register  acco'd  ng  to  t .#  ob,ect  image  ednteat  before  activating 
VI-SVS 

Figure  IV  24  snows  tn*  last  protocol  segment  considered  he'*  Tn*  subject 
indicates  completion  ol  the  vsua  conlirmaton  of  me  proposed  t’i*"g;e  ob,*ct  image 
by  statement*  [S12]  and  [S13'  In  tram*  V10  n#  r»o<es  to  me  r ght  to  regm  another 
at  tn*  complea  v*rt*>  |«u«itfi  3)  which  he  knows  i*  tne'e  (VERTEX  chunk  V24). 

Correspondingly,  rule  VW  lo*  VI-SVS)  set*  CP P to  VER1,  constructs  me  iconic 
verten  image  V57  in  VI,  and  sets  E*P  to  YES  belo'e  deactivating  (see  figure  IV  25).  As 
a hypothesized  object  mag*  .s  beng  visual/  contirmed,  AA  SYS  accordingly  n-jrks 
Image  Body  elements  (a  MAR<  p'ocerly  is  set  to  YES)  Thus,  rule  <027  Co*  AA-SYS) 
tires  with  th*  completion  ol  010  <0''rm*t.on,  as  EXP  is  YES  a"d  113,  bemg  (LIX  ot  (CR 
ot  GOLD,  has  been  previously  mamed  Th«  ru'e  changes  In*  active  goal  to  120 


Flfura  IV.  25 


AT  VERTEX  VERl 
DIR  IS  DO 
RAN  IS  10 
EXP  IS  YES 
ATT  IS  RT 

VI  IS  <V57  P58  X59  AM  X61  AM) 


AUT  •!:  AA-SVS 
RUE  *027:  GOAL  COMPLETED 
GO/L-IS:  1?D 

15,0  STM  (GOl  OIOINAME  TRIANGLE  DIM  TWO  TYPE  0BJECTXP4  II I * 
AI2  113  U4  A15  116  P25  133  A34  I35P49)  ) 

(V48(CR  X5?  PNUM  P49  VSPEC  (UO  DR)  SPEC  TE  TYPE  VERTEXXP49  X5- 
0 A55  X54  A53  X52  A5I)  ) 

(L37ICR  X52  VSPEC  DIAGONAL  TYPE  SIDE KP49  P25  P42  P4*  E38  140  * 
14 1 Q43  144  145  E47)  ) 

<V?4<CR  X26  PNUM  P25  VSPEC  <RL  U)  SPEC  TE  TYPE  VERTEX)  - ) 
(V3(CR  X5  PNUM  P4  VSPEC  (RTA  a)  SPEC  V?  TYPE  VERTEX) . ) 

<>()(>(> 


(Incorporate  2 - Dimensional  object)  md  activate!  INC-SYS  Tha  contanti  ot  VI  ara 
not  transferred  to  STM.  Tho  YES  valua  at  EXP  is  sutticiant  input  m this  cast. 

Rule  121  Of  INC-SYS  liras  to  incorporate  tha  object  OlO  of  tha  OOt -appandad 
chunk  and  its  immadiata  visual  contest.  Figure  IV  2i  indicatas  tha  balora  and  attar 
statas  Of  ITM  and  figure  IV27  petor  ally  illustrates  tha  new  ITM  contents  Tha 
incorporation  is  accomplished  by  removing  GOL  from  tha  010  chunk  and  copying  tha 
chunk  into  ITM  Tha  imago  body  of  tha  chunk  is  than  traversed,  incorporating  any 
chunk  containing  an  |maga  Body  alamant  which  is  linkad  by  equivalence  to  ona  in  tha 
incorporated  Object  image  During  this  travarsal,  a naw  start  location  is  also  chosan 
This  is  Ona  of  tha  contaat  chunks,  which  has  an  unknown  X1T  alamant  (typa  UEX).  It  is 
markad  in  STM  by  appending  tha  Spocial  alamant  LAST  to  notify  AA-SYS  If  no  chunk 
with  an  unknown  link  is  found,  tha  goal  becomes  N0M0  (NO  Mora  Objects).  In  tha 
currant  Casa  V24  is  markad  with  an  appandad  LAST,  and  tha  goal  becomes  SNO  (Start 
Naw  Objact)  as  shewn  by  Figure  IV.21 

This  protocol  - program  trace  comparison  is  continued  in  Chapter  112  as  section 

API. 

THEORETICAL  IMPLICATIONS 

Tha  esempie  protoc  at -program  trace  segment  illustrates  mast  of  tha  theoretical 
implications  imbedded  in  VIPS  Tha  integrative  and  generative  preceee  ef  visual  imaga 
construction  based  upon  aya  sensory  input  (perception)  is  Muetreted.  The  use  Of 
currant  imaga  contants  to  gmda  hole  (aya)  movement  behavior  and  input  interpretation 
s illustrated.  Tho  basic  activity  of  assimilation -accommodation  is  illustrated.  The 
proposed  imaga  representation  is  shown  to  be  both  ada gusto  for  and  furthermore, 
suited  to  its  role  as  a gmda  for  perceptual  activity 


GOA.  HuA'fO  EPISODES 


"he  processes  0*  VPS  le-cept  Vi-5>S)  use  the  mi*.*  of  "*  ■■'  ;a  «*  ’ 

P'.mar/  condition  fof  fdeter  mirv nt  oO  *jte  f.r.ng  T ns  .».  p e . *■'  nfn-;’.  '•**  >*  ' 0 

P'OtOCO  (perceptja  ) Deha.  0»  as  cons«st-rg  0*  a *e»  es  0‘  gOa  't'a't  : ep  ouer. 
f'gj'e  iV  ?9  graphical  usVat*'  ths  n?e»pre!a’  o*  of  'he  e«ampe  p'O’C  o segment 
in  tr-e  form  c * a “gOa1  rp'SOcie  c'  .»t“ 

The  chart  indicates  Tho«e  p'ofoco.  ’'a^es  * co^eipOf'«J  to  iare  confu'rent 
wtM  the  inferred  goa-  t'jns.t.o^  po.nts  o*  tne  oe^a  c*  tVl  v 3.  V9  and  Vll  of  tne 
figure).  The  vertical  -res  .nd-ca*p  a sequence  0*  one  O'  »»-o»r  no  e («?,er  rro.ements 
"o  tne  'eft  of  each  re  >s  tne  name  of  tne  cu're**  goa  »n.ch  s act.e  du'  "g  that  no  e 
<e/e>  frozen. ent  siquence  and  associated  fcena/iOr  ep.soae  To  the  right  of  each 
included  frame  number  uj*ac*eteu  <s  i.sted  an/  current  goa  s wh.ch  a*e  active  at  tnat 
protocol  po<nt,  hut  *i>th  Decode  nactve  (past*  p'tor  to  commencement  of  tne 
subsequent  ho>«  (eye)  movement  sequence 

Generali/  revea.ng  the  eiamp<e,  goa  s JtfsO  ana  S*0 2 are  associated  win  the 
initial  PEC-SYS  activation  by  AA$Y$  Upon  return  to  AA-$Y$  the  goa>  «s  changed  to 
K02  and  hole -movement  activity  begins 

At  frame  V3  conflicting  >npu*  causes  AA-$y$  to  reactivate  PEC-5Y$  wth  goal  P*l 
in  o»dcr  to  accommodate  ti»c  object  image  Goa  S*0?  results,  wh-ch  »s  changed  by 
AA-SY$  to  *02  and  hole  movement  aga  n begins 

Ths  goal  remains  active  until  protocol  frame  V9,  when  the  hypothesised  object  has 
been  completely  confirmed.  INC-SYS  »s  activated  w th  goal  I2D.  Upon  deactivation  of 
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1NC-SYS  the  tyttam  m«n  to  tha  new  toe  (lien  with  goal  SNO.  At  Unm  VI  la  REC-SYS 
it  activated  la  attempt  recognition  (tuggottion)  ot  a now  object  (goal  RNO). 

The  goal  epitoda  chart*  are  a combination  ot  protocol  information  drama  number*) 
and  traca  information  (inforrod  current  go*t*)i  Theta  chart*  ittuttral*  the  inferred 
factoriiation  (partitioning)  of  the  obterved  behavior  and.  at  wch,  an  important 
framework  for  tha  evaluation  of  protocol-trace  corretpondence.  Theta  chart*  are 
uted  throughout  the  thetit  a*  a condensed  repretentation  of  i object  and  lyttem 
behavior*  and  their  corretpondence.  The  evaluation  taction  of  Chapter  IL2  utet  ttv* 
epitodal  interpretation  at  a batit  for  judging  the  eiplanatory  ability  of  VIPS. 
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Cnapter  1.5  VIPS  Extensions 

VIPS  is  l'f*-  ted  «n  scope  aue  to  the  specific,  task  - re  ated  behavior  it  represents 
and  explans  Severs  n emory  extensions  and  gener*l,*at-ons  are  necessary  to 
complete  the  tneoret.ca  ae'ir.tion  of  t^e  visual  (cogn-t.ve)  processor.  Anotner 
component  Of  long  Term  Mi?mor  / is  defined  and  the  content  and  function  of  LTM  of 
VIPS  are  genera  ted  and  extended  The  image  representation  and  processes  *nvo  -ed 
n tl'»ee  dimensional  visual  form  perception  must  be  described.  A representation 
genera'ijation  is  necessary  to  define  a more  universal  vsuat  imagery  ability  Finally, 
the  processes  of  VIPS  must  oe  genera  ted  to  expla'n  the  eye -movement  and 
peripheral  vision  factors  of  visual  perception 

1 Memory  Extensions 

TCL’M  (Tempo?*  - Co-fe»t..a'  Long  'rerm  Memory) 

’emporal  - Contex’ua-  lor-g  Te»m  Memory  (TCvTV)  *s  the  component  of  'ong  term 
memory  wh.cn  ser  es  as  a permanent  reoositor/  for  tne  ep  sooa>  and  contexts- 
infor mat-on  represent*’  ons  ( ♦*  age s>  wn.cn  afe  in.t*ai>  constructed  as  the  contents  of 
ITM  (see  ( gure  VI)  Tnere'ore  tro  e'ements  o'  TClTM  are  images  or  other 
integrated  (interrelated*  *,»ructur*»  of  se  n- ted  (mean  ngtyi)  past  chunrs  of  STM 

lach  elemental  mage  of  fC  TM  nas  a-*  assoc-afed  label  e'empnt  Th.%  labe  attords 
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the  two  basic  means  01  access  to  the  memory  image's  content.  For  one,  the  label 
element  has  associated  properties  which  specify  information  at  to  the  time  and  place 
associated  with  the  initial  realization  of  the  image  in  ITM  These  temporal-contextual 
information  features  (Shiffnn  and  Geitler,  1973)  may  correspond  to  properties  of  a 
later,  current  situation  specification.  This  correspondence  affords  access  to  the  label 
element.  Each  label  element  also  has  properties  which  reference  content  elements 
within  the  associated  image  structure.  These  references  afford  access  to  the  memory 
image’s  content  after  access  to  the  label  element  by  temporal-contextual 
correspondence  has  been  accomplished.  The  content  -eterencmg  properties  provide 
the  other  means  of  accessing  the  contents  of  the  memory  images  of  TCLTM  Just  as 
the  features  Of  the  temporal-contextual  information  may  bear  correspondence  to 
cur-jnt  STM  contents,  content  elements  of  the  image  struc  ure  may  also  ba  equivalent 
to  elements  of  current  STM  and  facilitate  that  image’s  retrieval. 

In  the  extension  of  VIPS,  the  final  image  representations  (perceptions)  of  ITM  could 
become  TCITM  elements.  Prior  to  VIPS  deactivation,  by  a final  activation  of  INC-SYS,  a 
label  element  can  be  created.  The  final  values  of  the  F1RST-ITM,  LAST-ITM,  FIRST-OB 
and  LAST-08  reference  properties  of  ITM  could  then  be  transferred  to  the  label 
element  as  content  reference  properties.  Situational  properties  (temporal-contextual 
information)  could  then  be  specified  for  the  label  element,  also.  Upon  VIPS 
deactivation  end  the  accompanying  disengagement  of  the  cognitive  processor  from 
perceptual  activity,  the  perceptioi.  ( mage)  can  become  an  element  (the  most  recent)  ol 
TCLTM. 

Retrieval  of  TCLTM  image  elements  is  accomplished  by  an  active,  searching  process 
(Shi'fnn  end  Geisler,  1973).  Ths  search  attempts  to  locate  an  image  with  temporal* 
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contextual  or  content  failures  aquivi'e'.l  to  (host  provided  to  the  process  from  the 
current  contents  ol  STM  (a  sairch-sal)  Though  an  element  is  entered  into  TCLTM 
pe-manently,  forgetting  may  occur  as  a result  Of  the  failure  of  this  retrieval  (search; 
process. 

Accessibility  of  an  Image  element  of  TCLTM  decreases  as  a function  of  element  age 
(Shiffrm,  1970:  Tulving,  1970).  With  the  equating  of  image  accessibility  to  trace 
strength,  Wickelgren  (1972)  provides  further  support.  With  the  passage  of  time, 
features  of  current  temporal-conteituel  information  change.  Thus,  the  longer  an 
element  is  a member  of  TCLTM,  the  less  similar  is  its  temporal-contextual  information 
to  that  of  a current  search-set  (Shiffrm,  1968;  1970).  With  regards  to  retrieval  by 
content  correspondence,  the  probability  of  a TCLTM  element  with  similar  (equivalent 
features)  content  being  m TCLTM  increases  with  elapsed  time.  The  existence  of  such 
an  element(s)  decreases  the  accessibility  of  the  initial  by  being  a -ource  of  retrieval 
competition,  confusion,  and  interference. 

Recent  episodal  and  contextual  information  (memory  images)  play  an  important  role 
in  many  (most)  experimental  tests  of  memory.  Due  to  the  capacity  limitations  of  STM 
(Miller,  1956),  most  typical  tests,  such  as  the  recognition  of  a current  stimulus  as  an 
element  of  a previously  presented  set,  necessarily  use  a recalled  element  of  TCLTM. 
This  image  is  readily  retrievable  as  it  is  usually  a recent  or  the  most  recent  entry  of 
TCLTM,  or  may  still  reside  in  ITM 

When  an  element  of  TCLTM  is  retrieved,  it  becomes  the  current  imsge  of  ITM 
From  ITM,  the  structure  is  recellale  into  STM  in  part  or  as  a whole  (chunk  by  chunk) 
for  comparison  with  new  current  STM  contents.  Such  comparison  is  template-tike  in 
nature  being  an  attempt  to  directly  match  possibly  equivalent  image  structure  schema. 
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Such  equivalency  would  depend  upon  correspondence  of  i^age  eien*enl  urODert  e : 
which  specify  visual  features  and  spatial  interrelationships  During  perception  f a 
match  to  partial  input  succeeds,  the  retrieved  image  is  used  to  guide  the  perceptual 
behavior  as  are  newly  created  [hypothesised)  images. 

Statement  {$12]  of  Figu'e  V2  md  cates  one  of  trie  ra-e  instances  of  In  s behavior 
with.n  the  protocols.  This  scarcity  is  due  to  the  Oscrete  (discontinuous)  nature  ol  thc 
enperimental  visual  he'd  which  consisted  of  a senes  of  distinct  (on  y generally  related) 
line  drawings.  In  more  usuai  continuous  content  Situations,  REC-SYS  retrieves  images 
from  TCITM  (and  ITM)  with  greater  frequency.  TC  TM  was  not  implemented  in  VIPS 
due  to  the  rare  use  of  its  v,sual  image  elements  in  tne  protocols. 

The  use  ot  retrieved  TCLTM  images  to  guide  the  perceptual  activity  can  account 
for  the  result*  of  Noton  end  Star*  (1970).  Their  results  indicated  that  subjects  use 
similar  eye-movement  sequences  during  tho  recognition  ot  a previously  presented 
drawing.  This  indicates  use  ol  tne  visual  image  result  (perception)  of  prior  behavior  in 
« subsequent  perceptual  situation.  Furthermore,  Noton  and  Stark  propose  that  a 
perceptual  (visual)  imaga’s  content  strictly  reflect  (me  ude)  its  generating  eye- 
movoment  behavior  This  is  not  proposed  hare.  It  it  proposed  only  that  tha  sequence 
of  Input  views  influences  image  contents,  as  do  perceptual  goals.  In  later  perceptual 
use,  those  influenced  image  contents  inversely  effect  th#  eye  movement  behavior. 

SITM  (Semantic  Long  Term  Memory) 

I Semantic  Long  Term  Memory  (SLTM)  is  an  entension  of  the  LTM  implementeo  n 

VIPS.  It  is  thus  not  • new  memory  component,  but  replaces  LTM  in  the  linal  memory 
sytljm  proposal  (see  Figure  VI).  SLTM  is  a semantic  net  (Quillian,  1968)  Ot  a 
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conceptual-relational  nature  Kitsch,  197?;  Bowe*  and  Anderson,  i 973)  SUM  holds 
the  system's  symbolic  rep'esentjt  on  cf  abstrac*,  generai/ea,  tactual  know'edge  As 
such,  it  contains  (as  activatab'o  suo-structur  es)  associative,  heterarch»cai 
representations  0*  visual  information  (W  r/.ton,  19?0> 

Similar  representations  of  vsuai  information  ha  e proven  adequate  to  realize  ana 
explain  behavior  on  visually  related,  copn.t  ve  ta  *■$  Baylor,  197?;  Moran,  1973). 
Those  tasks  are  of  a more  ab  ,tra:t  nature  than  the  perceptual  activity  represented  by 
VIPS  Segments  o<  the  more  abstract  contents  o‘  SUM  become  partitioned  and 
activated  as  chunks  of  $TM  (Mo*an,  *973>  As  cr.unks  of  STM,  tnese  segments  of 
abstract  "fa  Is"  determine  (guide)  tne  subsequent  visuaUy  related  cognitive  act  vity. 

The  contents  of  SUM  and  PUM  are  alte'ed  by  learning  process  based  upon 
(accomodating  to)  current  ewpenence  (STM  contents),  EPAM  investigations  suggest 
RlTM  altri-ation  means.  Winston  (1970)  investigates  a means  for  the  updating 
(learning)  of  the  visually-meanmgful  contents  of  SLTM. 

2.  Three-Dimensional  Picture  Percept  on 

Picture  perception  differs  from  other  visual  perception  activity  as  the  visual 
environment  is  two  dimensional  A presented  line  owing  is  known  to  be  of  two 
dimensions  as  an  object  itself  That  some  straight  tine  drawings  are  perceived  >n 
three-dimensional  terms  (wdn  deptn)  is  a prime  example  of  wha!  E.  H.  Gombnch  refers 
to  ar.  the  "beholder’s  share"  of  visual  picture  per  ption  in  his  most  interesting  book, 
Art  and  Illusion  (Gombnch, I960).  The  three-dimensional  perception  of  pictures  occurs 
m the  absence  of  the  posit  ve  efferent  indications  of  accomodation  and  convergence. 

What  *re  the  basic  aspects  of  the  processes  and  memory  representations  which 
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become  involved  in  the  development  of  • three-dimensional  perception  of  e presented 
itr eight  line  drawing  ? Whet  characteristics  of  a line  drawing  lead  to  its  interpretation 
and  representation  in  three-dimensional  terms  » 

RELEVANT  PROPOSALS 

A prime  target  for  ettempti  at  euantifymg  Gestalt  organisational  laws  has  been  to 
esplain  the  perceived  three-dimensionality  of  certain  line  drawings.  Their  belief  is  that 
the  basic  organisational  laws  of  perception  will  attempt  to  realise  a description  of 
minimum  complesity  for  a presented  stimuli  (Tragnena*)  As  such,  a 'simple*  three- 
dimensional  perception  of  a line  drawing  results  as  favored  over  an  otherwise 
necessarily  'camples*  two-dimensional  perception.  Several  studies  by  Hochberg 
(Hochberg  and  Brooks,  1HO-,  Hochberg  and  McAllister,  1*53)  resulted  in  the 
development  of  a complesity  measure  for  straight  line  drawing  stimuli.  This  complesity 
measure  demonstrated  significant  positive  correlation  with  the  relative  perceived 
three-dimensionality  of  various  presented  stimuli  sets.  Attneave  and  Frost  (1969) 
carried  the  investigation  of  'minimum  principle*  implications  further.  Their 
esperimentetion  produced  results  which  indicated  that  the  perceived  slant  in  depth  of 
a tridimensional  perception  was  highly  predictable  from  basic  simplicity  criteria. 

These  studies  all  considered  the  'minimum  principle*  to  apply  to  the  presented  line 
drawing  as  a whole.  This  was  necessary  as  Gestalt  theory  offers  no  eiplanation  for 
the  integration  of  successive  'partial  wholes'  of  a stimulus  to  realize  its  perception.  If 
such  a 'minimum  principle'  were  the  only  source  Of  three-dimensional  hypotheses  and 
the  resulting  perceptions,  it  is  predicted  that  mention  of  three-dimensionality  in  the 
hole -moving  tack  protocols  will  occur  only  after  the  whole  line  ‘-swing  has  been 
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traversed  at  least  one*.  Vat,  subjects  definitely  mention  three-dimensional  idaaa  with 
only  partial  picture  information  available.  Thia  ia  clearly  aaan  in  tha  thraa  opening 
protocol  a af manta  presented  aa  F lures  V.2,VO^nd  V.4. 

From  thaaa  thraa  initial  protocol  segments  it  ia  apparent  that  local  pictura 
information  (avon  ona  vartaa)  ia  aufficiant  to  illicit  attampta  to  raahta  a three- 
dimanaional  line -dr awing  perception.  Simon  (1H7)  noted  tha  ability  of  an  attantion 
ahift  to  flip  tha  parcaivad  onantation  of  a praaantad  Meeker  Cuba  atimulua.  Hochberg 
(I960)  notad  tha  ability  of  local  dapth  cuaa  la  generate  propoaad  three-dimensional 
intarpratationa.  Tha  artiata  M.C.  Eachar  and  Hogarth  (Sao  Gragory,  1970)  wara  both 
adapt  at  croating  ’impossible"  picturaa  through  a combination  of  inconaiatant  lacalitad 
dapth  cuaa  (Sao  Figura  VS  for  an  esample).  Gragory  (1970)  mvaatigataa  aavara*  local 
dapth  cuaa  and  propoaaa  that  thair  parcaptual  affact  raaulta  Irom  tha  mamory  of  pact 
aapariancaa  involving  factual  - viaual  coordination. 

A THEORY 

Sinca  a lino  drawing  it  iltalf  a two-dimensional  object,  tha  initial  perceptual  sat  it 
naturally  toward  tha  realisation  ot  a planar  or  two-dimensional  perception  (vitual 
image  rapratantation).  Thit  perceptual  assumption  remains  m affect  until  a to-called 
"trigger*  varies  (or  feature  configuration,  in  general)  it  encountered.  A “trigger* 
varies  ia  one  having  three  esit  directions,  no  two  being  in  oppositely  oriented 
directions  (in  otha»  words,  *T*  vertices  are  not  included).  No  trigger*  vertices  are 
encountered  by  sublets  in  the  four  protocols  discussed  m Chapter  7.  No  mention  of 
any  possible  three -dimensional  interpretations  occurs  m those  protocols  either.  In  all 
thraa  initial  protocol  segments  of  Figures  V.2,  V.3,  and  V.4,  a trigger*  varies 
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consistently  elicits  mmed  ate  tnree  dimensional  considerations.  The  perceptual  effect 
of  a "trigger*  configuration  is  consistent  with  tne  experience  based  theory  (Gregory, 
1970)  and  with  the  local  application  of  the  Gestalt  "minimum  principle" 

In  the  usual  case,  two  vertex  exits  ot  tne  trigger  /ertex  are  bound  to  an  object 
face,  the  "prune  ta  e",  which  ,s  perceived  to  be  parallel  to  the  picture  plane.  The 
third  exit  direction  is  perceived  to  be  extending  forward  or  backward  ,n  space  (depth) 
and  oemg  the  edge  between  two  "secondary”  faces.  The  phrase  "in  the  usual  case" 
was  included  in  tne  description  ot  "trigger"  verier  perceptions  above.  Note  that  when 
the  perceived  depth  direction  is  down,  the  usual  interpretation  is  rejected  and  the 
other  two  vertex  exit  directions  (Still  ot  the  prime  face)  are  assigned  depth  meaning. 
This  may  be  an  inherent  result  of  tne  "support  hypothesis",  an  assumption  resulting 
from  the  normal  inability  of  an  object  to  hang  in  space.  Support  is  usually  from  below, 
denying  down  as  a viable  deoth  direction  in  physical  space  with  gravitation.  Figure  V.6 
shows  a "solid  octagon"  wth  ail  eight  secondary  lace  extension  directions  illustrated. 
The  starred  ("•“)  drawing  shows  the  faces  extendng  down.  In  this  case  these  faces 
are  not  percieved  to  extend  ,n  depth  as  usua  The  octagon  (prime)  face  is  percieved 
as  the  object  top  and  extends  m depth  itself 

The  decision  to  consider  a presented  picture  m three-dimensional  terms  is  a 
primary  perceptual  decision.  This  decision  results  in  the  application  ot  a set  ot 
perceptual  goals  and  associated  object  hypotheses  of  currently  active  goals  and 
associated  object  hypotheses  and  differing  from  that  realized  in  conjunction  with  two 
dimensional  considerations.  Aubrey  Beardsley,  in  his  ornate  art-nouveau  drawings, 
contraposes  complex  border  patterns  and  complex  pictorial  scenes,  both  often  sharing 
equivalent  components  (See  Figure  V7).  These  illustrations  afford  introspective 
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appreciation  ol  the  effect  Of  the  pattern  Of  three-dimensional  interpretation  decision 
upon  the  visual  experience.  Though  similar  visual  elements  occur  in  both  border  <nd 
picturo,  they  ere  experienced  differently  due  to  the  difference  m assumed 
dimensionality. 

Now  we  must  consider  the  activity  of  the  visual  processor  after  encountering  a 
*tri||er*  verier  At  the  strategic  level,  the  goal  K03  becomes  active,  which  w» 
attempt  to  recognize  a three-dimensional  prism-type  object  Such  objects  are 
recognized  in  terms  of  a prime  face,  which  serves  to  name  the  object,  and  several 
associated  secondary  faces,  which  usually  are  perciaved  as  eatendmg  in  depth. 

As  with  the  two-dimensional  case,  an  image  representation  of  the  object  >s 
constructed  in  STM  Each  face  is  represented  in  a different  chunk  Chapter  13 
discusses  the  VIPS  image  representation  of  three-dimensional  prism-type  objects  in 
conjunction  with  the  definition  of  the  FACE  type  chunk.  These  image  chunks  serve  as 
the  source  of  tactical  information  to  generate  visual  feature  expectetions  and  hole 
(eye)  movement  specifications  An  assimilation  accomodation  process  equivalent  to 
that  Of  the  implemented  i/stem  is  used  to  either  confirm  erpectat'Ons  or  alter  and 
abort  the  object  images  (es  conflicting  information  is  encountered) 

PROTOCOL  INDICATIONS 


The  action  of  assimilation -accommodation  is  well  illustrated  by  the  initial  protocol 
segments  of  Figures  V.2,  V3,  and  V.4.  In  Figure  V.2,  a block  (cube)  image  is 
hypothesized  as  a result  of  view  V3  (Statement  [S9P.  That  image  is  accomodated  to  a 
trapezoidal  block  image  at  V7  (Statement  [$14]),  due  to  the  conflicting  asternal  visual 
input  ot  that  view. 
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In  the  protoco1  seamen!  of  Figure  V.3,  commencing  at  a different  vertex  location, 
the  initial  three-dimensionj  interpretation  i$  dropped  due  to  conflicting  inputs 
encountered  »n  subsequent  vertex  views.  This  s a most  severe  accommodation  due  to 
the  primacy  ol  the  dimensional  decision  as  notej 

In  Figure  V 4,  the  subject  scans  the  prime  iacc  of  the  proposed  cubic  image,  so 
far  accepting  (assimilating)  tne  e«tra  vertex  exit  encountered  at  V7  into  the  three- 
dimensional  perception. 

spatial  consistency 

There  is  one  completely  new  perceptual  factor  which  enters  into  the  -ealization  of 
a th'-ee-dimensionai  image  representation  and  perception.  This  new  factor  is  tnat  of 
s^at-al  consistency.  The  determ.nation  of  spatial  consistency  involve*  the 
consideration  of  two  factors  One  is  fhe  constancy  of  depth  direction,  within  the  image 
as  a whole  and  more  importantly  for  any  given  ine  segment  w.thm  the  image.  The 
other  is  th<*  consistency  of  thr  n-depth  locational  interrelationships  between  tne 
various  feature  groupings  (vertices)  of  the  image  Chapter  13  d-scusses  the  inherent 
ambiguity  of  any  three -dimensional  interpretation  of  a planar  surface  The  perceptu*1 
system  must  construct  (by  chO'ie)  a non  amtvguOuS  consistent  visual  image 

Figure  V8  illustrates  the  two  possible  mcons-stency  factors  m example  line 
drawings.  All  of  the  examples  presented  there  are  inconsistent  when  perceived  as  two 
interacting  cubes.  Example  i.  .nvoives  only  the  inconsistency  of  perceived  depth 
direction  for  the  picture  as  a whole  Exampie  i involves  both  inconsistency  of  depth 
direction  for  the  whole  picture  and  inconsistency  of  perceived  vertex  locations.  This 
involves  the  added  irregularity  in  the  perception  of  pr>sm  projections  when  the  facial 
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extension  direction  it  down.  Thus,  when  considering  the  top  cube,  b i*  above  e,  while 
when  considering  the  bottom  cube,  b is  behind  a.  Note  the  introspective  "feeling"  ol 
bend  of  the  spuere  prune  face  e«  the  differing  m-dapth  directiena  act  to  warp  that 
face. 

In  example*  in  and  iv,  a face  ic  aherad  which  it  not  the  object't  prime  face.  In 
figure  iii,  the  tpeciai  cate  with  down  it  again  illuttrat  t,  At  with  example  i,  just 
discussed,  the  edget  a,  b,  c,  d of  the  thared  face  era  inconaittently  perceived  to  be 
extending  in-depth  in  one  (the  top)  obiect  related  perception,  and  to  bo  parallel  to  the 
picture  plan  with  regardt  to  the  other  cube  perception.  Again  incontiatenciet  ol 
ipatial  localiont  reiult.  Example  iv  involve*  the  mcontittanciet  of  perceived  depth 
direction*  for  lire  segment*  a and  b and  the  associated  reversible  depth  relatio  ships 
perceived  between  the  vertices  at  their  ends. 

FURTHFR  PROTOCOL  INDICATIONS 

To  illustrate  the  effect*  of  inconsistency  upon  the  visual  process,  three  protocols 
are  presented  which  show  tub  feet  hole -movement  behavior  upon  Example  iv  (tee 
figure  V.J).  Each  appendix  includes  a fully  transcribed  protocol,  an  active-goal 
epirode  chart,  and  a pictorial  representation  of  the  final  ITM  contents  at  inferred.  The 
ac'ive  goal  episode  charts  art  presented  as  figures  here  and  indicate  the  possible 
courto  of  VIPS  implementation  to  account  for  those  protocols.  The  co.npiete 
appendices  are  not  included  m tint  report  but  are  available  from  the  author  if  this 
detail  it  desired.  Dot*  occurring  in  the  geal  apitede  chart  indicate  episode*  of  activity 
not  straight -forwardly  explained. 

Consider  protocol  AP3  whose  geal  episode  chart  it  Figure  V.IO.  The  subject 
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attempt*  to  recognize  a taro-dimensional  ligur*.  with  goal  JO?  (nothin;.  suggested  ny 
th*  partial  information)  until  VS,  seeing  vertex  5.  This  "t"gger"  verte-  gene’ „us  t 1 
three-dimensional  (0*1  K03  Thu  goal  and  tho  accompanying  cube  >n  ape  guide' 
behavior  until  V33.  This  results  in  the  full  external  visual  scan  and  <ont,rmc*d 
perception  of  the  proposed  cub*  At  V39,  by  statements  [S44J  through  [Sue],  Inc 
subject  me  cates  the  realized  perception  ot  the  cube  and  statement  ;s4nj  narates 
attention  is  now  to  be  directed  to  recognizing  what  is  beiOw  that  cube 

At  V41,  the  subject  sees  vertex  4,  another  “trigger"  vertex  and  statement  [Sbl] 
indicates  that  another  cubic  goal  has  been  generated  to'  consideration  and 
confirmation.  This  guides  behavior  at  tn*  strategic  level  until  V5S,  where  statements 
[S65]  and  [SC6]  indicate  that  th*  incorporation  process  is  having  difficulty  due  to  the 
inconsistencies  ot  depth  direction  and  spatial  locations  of  the  two  cube  images  The 
behevioe  from  this  point  on  is  an  interaction  between  the  incorporation  (INC-SVS) 
process  and  th*  AA-SVS  process  in  an  attempt  to  resolve  inconsistencies. 
Reconfirmations  of  the  two  separate  cubes  *'e  realised,  but  the  inconsistencies  are 
never  resolved,  as  shown  by  th*  pictorial  representation  of  the  final  ITM  contents 
(figure  V 1J).  The  dotted  arrows  mdcate  th*  contacting  depth  directions  perceived. 
This  representation  allows  the  verba  i/ed  report  ot  two  cubes,  but  tails  to  be 
satisfactory  for  reproductive  drawing  generation,  as  shown  by  th*  appendix 

Considering  protocol  AS3  neat  (see  figure  V.I2),  th*  initial  goal  her*  is  to  search 
th*  outside.  Th*  "trigger"  vertices  don’t  overcome  this  goal,  which  is  active  until  VI 1 
At  that  point,  th*  subject  moves  inside,  possibly  in  an  attempt  to  link  up  with  vertex  7, 
which  he  has  seen.  When  this  tails  h*  moves  to  th*  outside,  linking  this  msid*  vertex 
with  *n  outside  chunk  he  has  kept,  from  view  V15  to  V6I,  an  exact  goal  structure  is 
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to  induce.  The  subject  generally  stays  to  the  Outside  contour,  constantly  noting 
<us  three-dirc  One*  interpretations  Ot  these  ve't'Ces  Though  the  word  cube  is 
'Oned,  there  does  not  appear  to  be  any  specific  eub<c  images  generated  for 
rmation.  Tfu  apparent  inconsistencies  ot  tn  possible  CUDIC  corners  IS  noted  m 
ment  [57?)  at  V33  Thus,  ! a p pea's  the  inconsistencies  of  depth  directions 
rated  by  *he  trigger  vert  ces  a'e  noted  without  c'nstruct  rg  complete  inconsistent 
images,  or  at  feast  without  attempting  to  first  confirm  these  cubic  images. 

At  V61,  th#  subject  fmaliy  decides  to  colder  the  pcture  m ".oca1"  terms 
ements  [Sill)  to  [S 1 1 3]>.  Th.s  -s  eqj'.a’ent  to  a dec  s*0n  to  perceive  the  picture 
vo  dimensiona1  terms,  instead  of  tne  three -dmensiona.  concepts  which  appear  to 
^consistent  Th.s  is  an  ind'cat*on  withm  th.s  protocol,  of  tne  fundamental  nature  Of 
a decision.  From  V61  on  the  suDject  operates  unoer  tn#  goafs  to  recogn.je  two 
•nsional  objects  end  to  incorporate  tnem  into  »TM  with  the-r  urown  pictor*a 
ronments  Th.s  mterpretat'On  .*  indicated  by  the  act.ve  goal  ep  sode  chart  of  the 
'nd'*  Indeed,  With  only  slight  mOQif  cat  on,  tr,e  Cur'er-t  »rp  ementat  on  cOu  a be 
c to  generate  benavo'  represenfat  /e  Of  tha:  ?oi ow"g  V61  Tn.s  activty  results 
tie  creation  Of  the  fr*  |?M  representation  as  d sp  ayed  P , F.g„re  V13,  which 
*s  correspondence  with  the  veroa*  and  o-a*n  descr  pt-ons  ontaned  from  the 
ect. 

One  final  protocol  »s  considered,  A.B3  (see  Figure  V.14)  Ag»m  the  initial  goal  here 
o sea'ch  the  outs  de  (SCO)  Upon  completion  ot  this,  tne  subject  recognises  the 
me  as  that  of  a cubic  project  on,  win  e*tra  internal  lines  This  image  is  incorporated 
ITM.  The  subject  then  d rests  attention  to  beg  n n^ng  ub  the  mside  directed 
s The  trigger  vert-ces  encountered  now  do  result  m the  three-d  mensionai  mside 
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object  proposals.  A senes  ot  perceptual  strategic  goals  becomes  active,  as  shown  in 
the  episode  chart,  which  results  >n  the  scanning  and  perceiving  ot  the  two  internal 
cubes.  Agam  the  final  description  is  not  free  of  ambiguity  or  inconsistency  (ser  Figure 
V IS).  The  fact  that  the  ITS*  representation  contains  the  outside  contou'  image  allows 
the  subject  to  anchor  the  drawing  within  thus  consistent  two-dimensional  framework 
and  achieve  a correct  d’ewmg  The  verbaliaations  dunng  drawing  and  the  sequence  ot 
drawing  (outside  contour  first)  favor  the  interred  representation. 

Considering  these  three  protocols  m full,  one  is  afforded  a greater  appreciation  of 
the  ability  of  the  proposed  .mpiementation  (perceptual  theory)  to  assnmlata  the 
extensions  necessary  to  generally  account  for  the  perception  ot  line  drawings  in 
three-dimensional  terms.  The  flexibility  ot  the  proposed  image  representat  on  is  well 
illustrated  by  the  examples,  also. 
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3.  Ganar«lmd  VkimI  Imaga  and  Perception  Syatem 

What  art  tna  entenaiant  and  modificetiana  naceuery  to  trencleta  ViPS  into  0 
cyctam  representing,  and  thut  enplaning,  the  complete  human  visual  information 
processing  system  ? First  of  concern  I tha  ima|a  rapratantation  ittalf,  in  tarma  of 
what  alterations  and  additiona  rust  bo  mado.  Given  thaaa  base  imagery 
(representation)  changes.  tha  necessary  modifications  ta  tna  pro poaad  viaual  processes 
to  accommodate  and  uaa  thaaa  altaratiana  can  ba  considered 

IMAGE  GENERALIZATION 

Tha  image  representation  muat  ba  altered  in  two  lundamantal  ways  Firat,  it  mua  t 
ba  sufficiently  ganaraliMd  ta  ba  capabla  at  embodying  all  poaaibla  (prebsblo)  viaual 
term  perceptions,  not  just  tha  raatrictad  anvironmant  at  straight  Ime  drawings 
Sacondiy,  tha  image  rapraaantatian  ragwraa  an  altaratian  ar  addition  ta  adoguetely 
rapraaant  tha  incamplota  intarmatianai  input  pravidad  by  paripharal  vision.  Tha  hote- 
mpvamant  task  which  haa  boon  madallad  by  tha  implamantad  ayatam  secludes  all 
paripharal  information  by  masking. 

Tha  couraa  takan  ta  raahaa  tha  ganaralitatian  at  rapraaantatian  s ta  prapaaa 
ganaralitad  imaga  chunk  and  alamant  classes.  Figura  V.ll  praaanta  tha  chunk  and 
image  body  ataman!  typaa  at  VPS  and  thair  aaaaciatad  ganarahaad  claaaaa.  Tha 
ganarai  imaga  chunk  claaaaa  aro  not  described  turthar  kotow,  aa  thair  namaa  indicate 
tha  cancapti  represented  Tha  imaga  body  tiawanf  ganarak saltans  dataradna  the  term 
at  tha  iaiaga  atructura  and  are  ducuaaad. 
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ELEMENT  GENERALIZATIONS 

The  image  body  OlOfKOnl  desses  re  defined  by  I how  members'  function  within  on 
image  body  (tructuro  «nd  aro  realr  I throu|h  « generalitotien  of  IhOM  olomont  lypoc 
mod  in  VIPS.  Invorioiy.  ooch  VIP.  olomont  typo  it  « tpocific  inotontiotion  of  ono  of 
tho  generalized  functional  classes  to  bo  dtacribad  here.  Thta  aot  of  generalized 
element  classes  and  tho  interrelating  interconnection!  which  are  allowed  aro  autficiont 
to  produce  all  vitual  form  image  repretenlationt. 

The  XIT  type  element  ol  the  implemented  tyctem  it  an  etample  of  the  functional 
clast  of  elements  which  interconnect  image  body  elements  of  chunks  representing 
spatially  disjoint  information.  An  element  A of  this  clast  normally  references  another 
element  ■ ol  this  class  through  an  interconnecting  link  of  space -traversing  moaning. 
Element  B references  olomont  A through  a to*  of  accordingly  inverse  space -traversing 
meaning.  Element  A and  element  9 aro  in  separate  image  chunks.  Each  element 
references  a Position  type  element  which  specifies  its  location  within  the  currently 
bound  locational  frame. 

Each  element  of  this  clast  will  have  properties  which  adequately  specify  this  mter- 
location  (Space)  traversal.  Using  the  XIT  element  at  an  esample,  each  XIT  element 
specif. os  the  direction  (DVX)  and  range  (RVX)  of  the  ipece  within  the  visual  field  which 
it  representationelly  traverses.  These  two  prepertiet  re  sufficient  to  define  a 
straight  line  segment,  given  the  perceived  location  of  the  initial  XIT  element  as  e 
starling  location  for  the  line  segment.  The  referenced  XIT  element  (by  LVX)  embodies 
complementary  traversal  information  to  allow  the  link  te  be  meaningfully  traversed 


(accessed)  in  either  direction. 
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This  traversal  of  space  or  change  of  location  may  bp  across  figure  of  ground.  The 
X1T  elements  as  proposed  are  consistently  utilized  to  tra  erse  the  figure,  embodying 
an  existing  line  segment.  Elements  of  the  general  class  may  span  "empty"  or  grour.d 
space  to  interrelate  differing  »rr  ge  chunks  of  differing  perceived  spatial  locations. 

An  element  of  this  functional  class  also  prov.des  the  necessary  nor 
traversing  links  to  Other  image  cements  w.thm  the  same  chunk.  An  XIT  element 
provides  the  links  named  by  the  properties  DiVl  and  DSV2  to  interrelate  it  with  other 
(ANCLE)  elements  of  the  vertex  Or  line  chunk  iM  which  it  be  ongs. 

The  functional  element  class  representing  a genera  ization  of  the  implemented 
INlfcRNAL  type  <mage  element  is  similar  to  that  just  described.  The  elements  of  this 
functional  class  are  primarily  used  to  agam  span  locrions  within  the  visual  field 
(image),  exceDt  that  this  linn  is  now  between  elements  of  the  same  chunk.  The 
INTERNAL  image  elements  within  OBJECT  image  chunks  “present  and  allow  traversal 
of  object  ime-segment  sides  Agam,  the  links  are  between  two  elements  of  the  same 
das«,  with  complementary  spatial  information  allowing  meaningful  traversal  in  either 
directi jn.  These  elements  allow  the  image  representation  of  visual  concepts  which 
span  locations  by  tie>ng  together  spatially  disjoint  groups  of  visual  and  spatial 
features. 

These  mtra-chunk  space-traversing  elements  provide  local  [Same  location)  links  to 
other  image  elements  of  the  chunk  which  are  embodying  other  feature  information  at 
that  perceived  location.  These  local  links  necessarily  maintain  attention  within  the 
chunked  concept  when  traversed  ("figure  - ground"  distinction).  These  elements  allow 
theimage  representation  of  vtsua  concepts  which  span  locations  by  tieing  together 
spatially  disjoint  groups  of  visual  and  spatial  features.  The  INTERNAL  type  elements  of 
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the  implemented  system  provide  one  such  link,  named  by  DIV1,  within  any  line  or 
object  chunk. 

The  functional  class  wh  eh  the  ANGLE  element  of  VIPS  exemplifies  is  that  class 
which  embodies  the  set  of  interesting  visual  features  found  at  some  location  within  the 
visual  field  (image).  What  features  are  of  nterest,  ana  thus  embodied  w th.n  such  a 
feature  element,  s determined  by  the  active  visual  perception  or  image  process. 

These  feature  elements  also  provide  the  necessary  means  for  their  traversal  by 
directed  attention  through  the  mage  representation.  Tne  ANGLE  type  elements  of  the 
proposed  implemented  ../stem  prov.de  the  links  na.ned  by  DIV1  and  D»V?,  which  aliOw 
theirconsideration  and  through-traversal  to  an  mterre  ted  INTERNAL  or  XJT  type 
element  Traversal  of  a feature  e ement  within  an  image  rep  esentation  does  never 
involve  ary  change  of  perceived  location.  Traversal  of  the  interrelating  links  wh.ch 
they  provide  allows  access  to  elements  or  elements  of  the  nage  existing  at  the  same 
location  within  the  same  chunk.  Feature  elements  of  dif  enng  cnunks  may  be  linked  by 
equivalency. 

f“>ne  last  generalized  functional  class  is  discussed  row  This  is  a generalization  of 
the  END  type  image  element  of  the  implemented  system  Elements  of  this  funct.ona- 
class  are  used  m image  chunks  wh.ch  represent  space  traversing  image  concepts 
which  cannot  be  satisfactorily  specified  solely  by  properties  of  space-tra/ers-ng 
elements  Each  such  chunk  has  a pair  of  these  End-class  elements,  which  are 
externally  (equivalently)  mterre  ated  to  either  a pair  of  mtra-chun*  or  a pa  r of  mtra- 
chunk  spa  e-traversmg  elements.  Tne  END  e'ements  of  the  implemented 
representation  ere  linked  to  XIT  elements  when  .n  LINE  chunks,  and  linked  to  INTERNAL 


elements  when  utilized  m SIDE  chunks.  Their  function  is  to  link  the  complex  space 
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traversing  concept  which  its  chunk  embodies  (SIDE  Or  LINE)  to  tho  appropriate 
elements  ot  other  chunk*  el  its  ends. 

The  Position  type  element  « it  hit  been  defined,  ascutted,  end  implemented  it 
elreedy  sufficiently  generalized  The  epplicetion  of  the  fuzzy  planer  location  reference 
frame  in  conjunction  with  a similarly  bound  fuzzy  depth  reference  provides  the  ability 
to  a'.ugn  perceived  or  imagined  locations  as  observed.  The  Chunk-Header  element  it 
provided  at  a means  ot  gaming  reference  to  an  image  chunk  and  to  embody  general 
Chunk  information,  such  as  the  chunk  type.  As  Such,  with  an  appropriate  eitension  of 
usable  symbols,  this  element  it  sufficiently  generated  also. 

Thus,  an  ot  the  image  elements  (eicept  the  QUICKSEE,  to  toon  be  ditcutted)  have 
been  generated  to  realize  d'sunct  functional  classes.  It  it  proposed  that  these 
general  element  classes  may  be  straght-forwardiy  instantiated  to  realize  a visual 
image  representation  of  any  probable  v.tuel  form  environment  The  image 
representation  0*  VIPS  it  an  .nstantis‘'On  tor  the  env.ronmenl  of  straight-line  line 
drawings. 
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PERCEPTION  SYSTEM  GENERALIZATION 

The  memories,  the  processes,  and  the  interrelationships  ousting  between  them 
which  are  discussed  in  Chapter  L4  form  the  basic  system  structure  of  the  human  visual 
processor  (Figures  IV 1,  IV.2,  IV.3).  TClTM  also  plays  an  important  role,  as  discussen 
earlier  in  this  chapter  (Figure  V.l). 

The  perceptual  theory  stated  generally  is  that  successive  partial  representations 
of  the  external  visual  environment  are  meaningfully  integrated  by  the  assimilation- 
accommodation  process,  with  appropriate  aid  from  the  recogn.tion  and  incorporation 
processes,  to  realise  a complete,  visual  image  representation.  The  final  image 
• epresentation  is  capable  of  generating  verbal  and  drawn  descriptive  Outputs  and  of 
generally  guiding  behavior  within  that  given  environmental  conteit.  It  resides  in  ITM 
as  a structure  of  interrelated  image  chunks.  It  is  necessary  to  reca>  nto  or  maintain 
in  STM  the  image  chunks  of  interest  to  actively  guide  or  produce  such  relatea  activity. 

THE  PERCEPTUAL  GOAL 

Strategic  control  is  maintained  by  an  ever-present  internal  state,  the  currently 
active  goal.  This  currently  active  goal  is  fundamental  in  determining  what  information 
of  that  which  is  currently  accessible  and  available  is  relevant  and  worthy  of  attention. 
This  goal  also  influences  the  dess  of  image  or  other  representational  structure  into 
which  the  currently  interesting  information  is  to  be  integrated.  The  active  goal,  in 
conjunction  with  tno  currently  attended  image  content,  is  basic  to  tho  determination  of 
eyemovement  and  fiaation  point  choices  Thus,  the  goal  influences  tho  structuring  and 
attending  of  the  perceptual  image. 
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The  question  trues:  What  is  the  source  of  these  goai  types’  The  initial  goal  type 
to  become  active  is  primarily  a derivative  Of  the  current  overall  cognitive  goal  type 
active  prior  to  the  initiation  ot  the  visual  perception.  Any  sensory  stimulation  is 
interpreted  in  tight  ot  the  pre-eostent  and  reactivated  state  ot  the  system.  The 
subjects  ot  the  hole-movement  lass  had  as  their  pre-set  cognitive  goal  one  reflecting 
the  desire  to  achieve  a perception  ot  tne  presented  line  drawing  sufficient  to  enable 
subsequent  verbal  and  drawing  reproduction.  From  this  goal  were  derived  either  the 
goal  SEO  or  me  goal  BNO,  being  the  first  active  goals  of  the  two  imolemented 
perceptual  strategies 

Given  an  initial  goal  derived  from  a pre-perception  condition,  tho  sequence  of 
currently  active  goals  is  generated  through  an  interaction  of  the  active  goal  and  the 
available  visual  (icon)  and  image  (STM)  information.  This  is  the  essence  of  any 
assimilation-accommodat  on  scheme:  the  strict  mterdependjnce  between  currently 
active  goal  and  the  Currently  available  information  ot  the  image  representation. 
At  any  point,  the  interaction  between  active  gbal,  active  image  contents,  and  the  newly 
fueled  visual  information  may  result  m the  initiation  of  a new  active  goal.  A network 
of  uni-leveMed  goal  transitions  was  inferred  from  the  observed  behavior  of  the  hole- 
movmg  task.  With  the  availability  ot  peripheral  information,  some  slacking  ot  goals, 
due  to  the  mutiplioly  of  hypotheses  possible  with  more  input  information,  may  occur. 
It  is  proposed  that  tne  stacking  of  hypotheses  and  goals  within  the  visual  process  is 
still  very  shallow,  probably  of  a depth  of  at  most  two  or  three.  This  is  a direct  result 
Of  the  strong  interdependence  between  the  icon  and  accessed  image  and  the  active 
goal  during  ass  milation  - accommodation.  This  interdependence  reduces  drastically  the 
value  of  any  long  -ange  plan  of  attack  embodied  within  an  elaoorate  stacking  of  future 
goals. 
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Support  for  the  role  ot  an  active  goal  (goal  type)  in  the  human  practising  of  visual 
information  comes  from  several  sources  external  to  this  thesis.  Eye -movement 
recordings  ol  re»dmg  activity  md.cate  the  goal-oriented  direction  ot  attenSion  across 
lines  of  presented  text  (Yar&us,  1967).  Yarbus  reports  that  varying  the  instruct  ons 
concerning  the  eventual  questions  to  be  asxed  about  a presented  complex  picture 
greatly  alters  the  subject's  eye  fixation  activity.  In  more  rudimentary  visual  search 
tasks  involving  target  location  (Williams,  1967,,  search  patterns  xxere  shown  to  display 
random  characteristics  only  m the  absence  of  information  about  the  search  target. 

These  studies  indicate  the  affect  of  a pre-set  cognitive  goal  upon  the  subject’s 
direction  of  attention  within  a presented  visual  environment  Their  results  indicate  the 
close  interdependence  between  the  active  perceptual  goal  and  the  presented  visual 
environment  throughout  the  subsequent  visual  processing  activity  Areas  o*  the  visual 
envi.  unmunt  are  fixated  in  accordance  with  their  believed  relevance  to  the  perceptual 
task. 

A p existing  goal  likewise  has  been  shown  to  have  an  effect  upon  the 
representation  of  the  visual  perception.  Chase  and  Clark  (1972)  conducted  an 
experiment  invol  mg  the  comparison  of  pictures  and  sentences  for  meaning 
equivalency  . When  the  sentence  wes  provided  first,  the  subsequent  encoding  of  the 
picture  eppears  to  be  contingent  upon  (influenced  by)  the  form  of  the  sentence.  The 
sentence  provides  a pre-enctent  goal  (internet  state)  wh-  n guides  the  development  of 
e picture  representation  suited  to  the  required  comparison. 

PERIPHERAL  VISION 


Peripheral  vision  input,  ths  primary  informational  difference  between  the 


implemented  end  generated  processing  system,  appear.  to  pity  two  significant  roles. 
First,  m conjunction  with  tny  currently  proposed  perceptual  hypothesis  or  active  goal, 
it  is  instrumental  in  determining  the  necessary  pre-set  range  and  direction  lor 
performing  saccadic  eye -movements.  Hebb  (1949)  noted  tnis  role  ot  peripheral  vision 
input.  The  use  of  eatra-foveal  information  in  the  selection  ol  a new  (nation  position 
has-been  confirmed  from  data  obtained  in  several  visua  search  tasks  (Williams, 
1966;1967).  Either  the  direction  and  range  of  a saccadic  eye-murement  is  pre-set  by 
AA-SYS  or  a peripheral  element  of  the  current  icon  (see  below)  is  marked  as  the  area 
of  the  visual  field  to  neit  fixate  VI-SYS,  with  access  to  the  icon  (VI),  could  then  itself 
generate  the  direction  and  range  m terms  of  a t.xed  retinal  location  relation.  VI-SYS 
would  then  deactivate  only  after  properly  fixating  the  prior  peripheral  area,  this 
postbly  involving  one  or  more  corrective  saccades. 

Secondly,  peripheral  vision  appears  to  play  a significant  role  m both  generating 
end  confirming  proposed  hypotheses  concerning  the  erte'nal  visual  environment, 
supplementing  the  more  accurate  information  obtained  m the  filiation  point  area,  in  a 
visual  search  task  involving  pattern  discrimination  (Gould  and  Oil,  1969),  peripheral 
vision  appeared  to  supply  sufficient  information  to  allow  superficial  judgements  of 
pattern  'similarity*  and  to  effect  accordingly  the  probability  ot  toveal  fixation  of  a 
pattern  in  a matching  task.  External  research  indicates  support  for  both  processing 
roles  of  peripheral  vision  that  are  proposed  above.  Directly  acquired  data  of 
Experiment  I!  will  be  seen  to  provide  data  favorable  to  this  interpretation  of 
peripheral  vision's  roles  in  perception. 
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PERIPHERAL  INFORMATION  REPRESENTATION 

The  proposal  for  lha  raprasantation  of  fho  peripheral  vision  input  to  I Ha  visual 
parcaption  system  is  to  generalize  upon  lha  QUICKSEE  typa  ima|a  body  alamant.  This 
typa  of  alamant  has  baan  introduced  into  lha  proposad  raprasantation  to  realize  the 
inferred  incomplete  embodiment  of  vartaa  Information  developed  in  the  case  of  a 
subject  moving  continuously  through  an  encountered  varies.  It  is  this  characteristic  of 
incomplete  representation  which  is  proposad  to  typify  the  available  information  of 
peripheral  visual  input.  As  such,  an  appropriate  generalization  of  the  QUICKSEE 
element  is  proposad  as  the  estension  sufficient  to  embody  peripheral  information. 

This  element,  in  its  generalized  torm,  will  be  called  the  Peripheral  element. 
Elements  of  this  class  are  proposed  to  embody  a density  measure  of  possible 
interesting  visual  environment  character  .tics  at  locations  of  high  discontinuity  m the 
periphery.  Which  of  the  available  peripheral  elements  are  considered  at  any  pent  is 
again  a function  of  the  active  perceptual  goal.  An  element  of  this  class  references  a 
position  type  e'ement  embodying  its  fuzzy  location  in  reliter  to  the  filiation  location. 
The  imagmal  space  of  perceived  locations  is  not  Known  at  this  fi'Cmci  stage  of 
processing.  These  elements  fail  to  provide  any  interrelating  links  to  othe'  image 
elements  of  the  visual  input.  These  two  stated  characteristics  are  the  results  ol  a 
consideration  of  enpenment  II  data  to  be  discussed  below. 

rho  adequate  representation  of  peripherally  available  visual  information  by  one 
such  symbolic  element  type  is  admittedly  doubtful.  The  is  due  to  the  indistinct 
dichotomy  ousting  between  toveal  and  peripheral  visions  There  are  not  two  separate 
and  dist  rict  levels  of  visual  acuity  ousting,  as  such  vision  dichotomy  appears  to  imply. 
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Instead  there  s a continuous,  though  rapidly  dccre.is.ng  evei  of  visual  acuity  with 
npLit  visual  angle  eccentricity  (Mande  baum  and  S oar,  *947).  There  is  not  agreement 
as  to  the  actual  area  of  the  visual  field  considered  to  be  foveal  vis  O'\  though 
generally  the  estimate  s somewnere  between  a l to  3 degree  central  angie.  As  such, 
there  This  discussion  assumes  that  visual  acuity  s rented  .0  the  amount  of  features 
available  for  represent*!  on  and  thus  to  the  type  or  symbolic  element  wh-ch  may  be 
util. zed  for  such  encoding  As  suen,  there  may  not  oe  one  specific  eiement  type  which 
is  used  to  represent  peripheral  v s*on  information. 

in  tne  discussion  to  to.ow  concern.ng  the  proposed  visual  processor,  ine 
generalized  QuICKSEE  (peripheral)  e>ement  .s  used  The  controversy  concerning  such 
a proposal  s simply  bemg  duly  noted  nere.  The  basic  nypothesis  is  that  peripheral 
vision  content  can  t>e  r^fiaentiy  represented,  by  a screte  symbolic  means.  The 
discussion  of  data  to  follow  indicates  support  for  th.s  nypothesis. 

THE  SINGLE  (INITIAL)  FIXATION 

Part  I of  Experiment  II  was  designed  to  give  some  results  relevant  to  inferring 
what  information  becomes  ava  lable  from  an  mit.al  fixation  upon  a presented  line 
draw  ng.  As  such,  and  as  noted  previously  (Chapter  12),  each  Ime  drawing  was 
presented  for  one  quarter  to  0"e-th»rd  of  a second  duration  with  the  fixation  point 
bemg  pre*set.  Immediate1,  upon  removal  ot  tne  sttmuius  the  subject  was  to 
simultaneously  d'aw  and  verbalize  h>s  pa-*iai  percept. on  of  understanding  of  the 
drawing.  Thus,  the  results  not  so  much  reflect  the  mmed«ately  available  "conic** 
memory  as  they  do  the  ^esui’s  of  the  processing  of  this  input  information  by  the 
perceptual  system.  There  is  no  attempt  to  interrupt  the  processing  to  get  more  direct 


i 


) 


1 


/• 


indications  of  the  rcdmc  represent*!  on  (the  contents  of  VI  »n  the  proposed  system)  as 
done  by  Sperling  (1960).  The  primary  interest  here  s to  determine  what  are  the 
possible  results  of  the  processing  of  the  initial  gl»nce.  This  can  yield  indications  as  to 
its  influence  over  the  subsequent  visual  processing  whch  would  follow 

The  results  ind  cate  that  the  initial  glance  is  r.deed  a vaLable  source  of  perceptual 
hypotheses,  in  the  form  of  constructed  images  with  high  correspondence  to  the 
features  of  the  input  information.  These  images  serve  as  the  basis  for  the  operation  of 
the  assimilation-accommodation  procedure,  which  accord. ngly  directs  attention  and 
develops  a final  consistent  representation  of  th#  presented  stimuli 

The  discussion  to  follow  references  Appendix  A.  F nation.  Th#  appendix  contains 
several  groupings  of  data  and  associated  nterpretat.ons  Each  grouping  begins  with 
the  presented  stimuli,  with  a staf  (•)  serving  to  cenote  the  pre-set  fixation  location. 
The  following  page  displays  a subject's  verba  and  drawn  response  to  tne  presented 
stimuli.  Following  this  is  a page  of  intermediate  interpretation  of  this  response  »n  the 
form  of  pictorial  representations  of  the  images  constructed  and  their  re  ahonship  to 
the  proposed  icon  image 

To  begin,  consider  group  l of  the  appendix  As  can  be  seen  the  fixation  point  was 
in  the  lower  left.  Figure  (a)  of  the  interpretations  page  (page  3)  »$  the  inferred 
contents  of  the  visual  information  cell  (VI)  at  thi«  fixation  pomt  There  .s  a fun 
representation  of  the  immediate,  fixated  corner  and  tne  circles  indicate  per  pheral 
information  elements  whch  embody  visual  field  discontinuities  as  discussed  previous 
n the  chapter.  As  noted  above,  no  attempt  was  made  to  get  more  direct  indications  of 
th  s input  representation.  Through  the  discussions  to  follow,  I hope  to  show  that  this 
representation  (involving  the  peripheral  elements  m conjunction  w tn  a full  fixated 


121 


V«fte*  representation)  bears  some  lunctional  relationship  to  the  obtained  results  This 
is  still  an  uncertain  area,  needing  lurlhe’  aapenmentation. 

As  can  be  seen  from  the  verbal  and  drawn  response  (p.^e  2),  the  subject  reacts 
to  the  "trigger"  verier  that  has  been  lirated  and  accordingly  proposes  a cubic  image 
tor  verification.  This  is  seen  to  lit  fairly  well  with  the  interred  input  information,  as 
Shown  m Figure  lb)  of  page  3 of  the  append,..  The  subject  apparently  further 
notes  the  emstence  of  the  peripheral  element  not  accounted  for  by  the  regular  cubic 
projection  shown  m the  middle  of  the  middle  edge  of  Figure  (bl  This  leads  to 
uncertainty  in  the  initial  proposed  image,  and  so  to  the  transparent  image  development 
as  noted  m Figure  (e).  This  response  indicates  the  influence  of  peripheral  vision  in  the 
development  of  the  perceptual  mage  proposals.  With  no  peripheral  vision  the 
proposal  would  have  been  only  that  ol  Figure  ib>.  as  occurs  repeatedly  m the 
protocols  of  the  hole-movement  la  - With  the  peripheral  vision  a problem  with  that  is 
noted,  possibly  resulting  ,n  two  competing  mages  for  possible  confirmation  This  could 
serve  to  direct  attention  immediately  to  the  trouble  spot  to  determine  ,f  that  can  easily 
b®  assim<i«t*d  into  th®  initial  solid  cubic  projection. 

Group  II  ,S  now  considered.  As  can  be  seen  the  tiaetion  ,»  ,n  th.  lower  left,  and 
the  inferred  input  is  shown  in  Figure  (a)  Ot  th.  interpretations  on  page  6 of  the 
append,,.  Tr,  sub|.ct  notes  that  the  e.ternal  out, me  .s  that  ot  a square,  again  noting 
the  importance  of  that  strategy  o'  -.sue,  perception,  es  previously  embodied  by  HAAS 
tor  the  hole -moving  lash  Figure  lb)  indicates  how  that  image  propose!  could  be 
r®lat®d  to  (drrivod  from)  th®  mf»rr®d  input  r®pr®%®ntatiOn 

he  "trigger"  verte,  tnat  has  been  listed  leeds  to  an  attempt  a!  three  dimensional 
interpretation  again.  Figure  (c)  morales  a possible  attempt  at  fitting  this  perception 
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proposal  to  the  input  representation.  The  subject  does  pause  appreciably  after  noting 
the  three-dimensional  possibility.  There  appears  to  have  been  loo  many 
inconsistencies  cutting  between  this  image  proposal  and  the  input  information.  Thus, 
the  subject  ret  ires  to  the  image  of  Figure  (bl  to  guide  the  assimilation-accomodation 
process.  The  need  to  determine  the  interaction  of  the  inward  directed  lines  appears 
to  be  the  goal  which  ne>t  would  have  been  utilized,  as  in  MAS  for  the  hole-moving 
Again,  peripheral  vision  appears  lo  have  a valuable  position  m the  processing  It  has 
provided  sufficient  information  to  lead  to  an  apparently  rather  certain  ‘square* 
propose1  for  the  asternal  edge  without  further  scanning  required  The  image 
hypot  msis  without  peripheral  vision  input  would  hare  been  the  cubic  projection  image 

Group  III  further  gives  indications  of  both  peripheral  vision's  power  and  its 
limitations.  Two  subject  responses  are  included  m this  group  As  seen  the  fuation  is 
in  the  lower  corner  of  a cubic  jrojecl'On.  Figure  (a)  of  the  interpretations  (page  10) 
indicates  the  inferred  input  into  matiOn 

doth  subjects  report  seeing  two  solid  blocs  type  objects  figures  lb)  and  (c)  On 
page  10  of  the  eppendu  indicate  possible  m1erreiatiOnsh.ee  between  the  two 
proposed  Object  perceptions  and  the  input  information  There  one  object  has  been 
completely  bound  only  to  peripheral  cements  It  is  not  cier  t»«,  so'ely  derived 
from  those  elements,  as  the  ‘trigger'  verteu  of  the  (,«at  on  area  has  led  to  an  attempt 
at  a three-dimensional  interpretation  m tne  foregouno  Th.s  course  e!  interpretation 
surely  has  some  effect  upon  the  development  of  the  proposed  cubic  image 
interrelating  the  other  peripheral  elements  of  the  visual  information.  Thu  indeed  'S  an 
indication  of  the  ability  of  peripheral  vision  to  aid  m the  proposal  of  perceptual 
images,  as  one  object  proposal  interrelates  solely  peripheral  information  elements. 
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Yet,  both  SuO,eets  were  unc*ear  conceding  tre  spa!  a irterrelabonsh-p  «'st.rg 
between  the  two  ob,ect  proposals  (See  drawn  responses).  It  appears  that  tne 
periphery  elements  ;o  rot  adequate'/  er^oa/  all  of  the  informat.on  r-ecessar/  *0 
propose  or  rea‘?e  t*e  ecu  /ae"Cy  ana  other  spatial  infraction  re  at  ons  when  may 
occur  between  oojects  ru»tr,e,  e>e  ti«a!>ors  are  reduced  to  *u«iy  aeve'op  these 
ooject  irterract  on  'ep'ecenta!  w 

In  conclusion,  the  -n  * a ' .at. on  s a source  of  pe'ceptua1  hypo’neses  (image 
churns)  Trese  mage  chunks  p'Ovipe  a bas-s  fo'  subsequent  assimilation  - 
accomodation  Per  phera«  "‘o'ma'.O'  p-a/s  a s gn.f  ca^t  ro'e  **  forming  these 
preposa  s ’he  represer*a»  on  of  per  p^e^a.  rout  that  ■$  proposed  appeals  to  be 
functionally  adequate  as  a oas-s  for  t*e  e«p'anat'On  of  the  behavior  observed 

EYEMOVEMcNT  SEQUENCES 

Attent  on  r-' « tu^s  to  a a scuss-on  of  several  of  the  e>e  movement  protocols 
ootaned  througn  3aft  ;j  o * Experiment  H.  Appens,*  A.EYEMOVE  contains  e.ght  sets  of 
data  Each  set  consists  of  a page  illustrating  the  eyemovement  sequence  Observed  for 
a subject  upon  tne  ne  drawing  shown.  An  mibai  sect  on  of  the  eymove’nent  sequence 
has  oeen  appropfate  y interconnected  by  dotted  lines  Two  numbers  are  associated 
w th  each  dotted  fiwat.on  po  nt  rne  mat -on  number  ».n  tne  sequence  is  given,  and  then 
in  parenthesis  the  dur  ,tion  of  the  tuition  »n  sutieths  of  a second  -s  indicated. 
FoliOw  ng  each  eyem overt  sequence  s a page  presenting  tne  resulting  verbal 
descriptive  resp^ns?  obtained  and  the  subject's  drawing  from  memory.  As  mentioned, 
there  are  eight  s»jts,  two  subjects  on  fouf  Ime  drawing  stimuli.  These  lire  drawings 
were  used  previously  in  the  ho*e -moving  task.  No  subject  recall  of  the  complete 
pictures  occurred.  This  md  cates  that  TClTM  images  did  not  p ay  a significant  role. 
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One  general  data  dimension  to  consider  is  the  duration  of  eye  (nation.  The  graph 
o<  Figure  V17  indicates  that  (nation  duration  varies.  The  activity  ot  assimilation  - 
accomodation  requires  vary  ng  jmjunts  ot  processing  at  each  tnat  on  point,  as 
exemplified  by  VIPS.  Assuming  that  Inaton  duration  s directly  related  to  the  amount 
ot  processing  done  at  a f >at  on,  this  general  level  0(  data  consideration  does  not 
discourage  an  assimiletion-accomodaton  explanation. 

More  specifically,  Figure  V 18  presents  the  (nation  durations  lor  the  Inst  four 
fixations  of  tne  eight  sequences,  in  all  Out  one  case,  the  first  (nation  is  consistently 
longer  than  the  second  (actually  the  longest  ot  the  first  four)  and  the  difference 
be' a en  their  averages  is  significant  The  initial  (nation  has  been  described  as  a 
source  of  perceptual  hypotheses.  The  duration  comparison  indicates  that  such 
extensive  processing  may  be  occurring  at  that  pool.  The  exceptional  case  involves  a 
Ime  drawing  which  ncludes  two  overlain  objects  (as  percc  ved).  As  the  equivalent 
examples  of  VIPS  activity  ind  cate,  this  may  cause  re-recognition  (image  accomodation) 
which  results  in  appropr.ately  longer  (nation  tunes  during  the  object  scan  tor 
ci  nfumation 

In  general,  a relatively  lengthy  (nation  is  followed  by  several  shorter  fixations. 
This  is  favorable  to  the  behavior  interpretation  proposed  here.  Recognition  activity  is 
followed  by  several  fixations  for  hypothesis  confirmation  (assimilation)  or  rejection 
requiring  image  accomoJ„'  on.  The  veriaOiiity  of  hypothesis  success  end  necessary 
environment  assimilations  during  confirmation  yield  the  irregularities  in  the  cycles  ot 
fixation  durations. 

To  facilitate  discussion  below,  the  fixation  durations  have  been  classified. 
Durations  of  8 to  16  sixtieths  of  a second  are  short  (See  the  bottom  of  Figure  V 17). 
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Fixations  from  17  to  27  s ■!  etrs  o‘  secono  i^e  n»ermeaia»e  Fixations  Of  23  to  4? 
sixtieths  of  a sec  'i  are  o-g  a-  a ’nose  a'e  lorgv'  stul  a^e  very  to^g  Tn.s  is  not 
a classification  based  upon  statstcai  duster  ng 

Now  considering  *re  Vst  e/e-mOve^ent  .ilustration  SI  In  t er^s  of  fixation 
tergtns  tne  first  »s  mterrreo  ate.  to 'Owed  0/  two  snort  f.«at.ons  *he  first  l.M’on  nas 
been  noted  above  as  be>ng  > provioer  o?  proposed  perceptual  (vsua't  images.  >e 
two  following  Qu.c*  fixations  can  be  then  interpreted  as  f jnct  c**’ »/  ccnt.r"  ng  feature 
groupings  as  proposed  ’He  fourth  nation  is  aga  n mtermc  d'ate  >n  length,  followed 
aga -n  by  two  short  f**a*io*s  Thus,  as  inferred  w th  tne  hole*mov*ng  task,  the  subject 
appears  to  be  engaged  »n  a eye  .cal  app'-cat  on  of  the  r©Cogn,?.on  process  n 
cooperat'On  with  subsequent  e/e -mqvemen's  gu'ded  by  t*e  ass  n iat  on  - accomodaton 
process  on  tne  basis  of  those  mages  proposed  {constructed)  *n  $TM  3otn  ♦ *at>ons  7 
and  6 are  ntermea-ate  «n  'engtn,  ,c"Owed  by  a iorg  f.«aton  9 Tm$  cou-d  ."a.cate  an 
incorporat  on  phase  for  t^ose  ob,ects  tnus  *ar  sat  stactorly  conf.rmed  The  suoject 
tnen  commences  to  rescan  the  p'Cture,  vewng  fuMner  parts  of  the  peturf  previous./ 
seen  only  tnrOugn  per.pnera.  v s on  7n.*  could  be  to  fully  develop  ’he  representation 
to  ba  suffioe-M  for  draw"g  purposes. 

Turning  to  sequence  Pi,  <t  s noted  tnat  tne  staging  f.*at.on  po.nt  offers.  ~n,s 
was  not  intended.  but  dd  ><e'd  an  ."terest  ng  resu  t Aga  n the  subject  engages  ■ «* 
long  first  fixation.  f0*!o*ed  by  two  short  fixatO***  The  h.gner  'Ca*  on  o‘  tne  in  t 4 
fixation  has  apparent  , a‘io*ed  a be*’er  ce'ceptua  ”-age  proposal  ‘or  tne  top  f'gu'e 
Of  tn©  i.ne  drawing  |na«  .n  »«»0uence  SI  *h*s  has  J'Jwn  tne  attention  of  t'-e 
perceptual  process  to  t*at  fgu'c  ea»  .<•*  man  *n  Si  Th-s  ofference  >s  not  only 
indicated  m the  eye -movement  sequence,  but  a so  *s  carr.ed  througn  mto  the  sequence 
of  the  verbal  description. 


! 

i 

l 


■*-w 


126 


This  subject  (P>  ulilizes  long  fixations  more  frequently  than  subject  $ This  could 
be  indicative  of  a more  p>ece-meal  approach  to  incorporation.  The  top  object  may  be 
incorporated  at  t nation  4 and  the  slim  rectangle  to  tne  right  may  oa  recogrvzed  and 
incorporated  at  ( >jt>on  5.  This  woud  imply  an  mt  a y heavy  re'iance  upon  peripheral 
information  for  object  reeognit  on.  From  a genera'  anaiys  s of  the  sequences  recorded 
an<j  those  illustrated  «n  the  append**,  it  appears  that  s ch  initial  reliance  <s  utilized. 
This  is  fol*owea  by  a r?scan  often  vs't.ng  feature  locations  previously  not  fixated 
Often  later  attention  s reo-rected  to  areas  of  object  interact  on  several  times, 
apparently  to  conf,rm  tne  proposed  'mage  nterractions.  The  lower  right  corner  of  the 
r ght  hand  square  >s  never  fuated  «n  Pi,  while  other  mti  /•act  on  areas  near  the  center 
of  the  pcture  are  re  t xated  frequently  Tne  subject  ras  dfficulty  wh«n  draw.ng  th.s 
pcture  area  Tns  wOu>d  correspond  to  ?^e  inaoility  of  pe' phera'  information  to 
embody  oo  ect  image  nterract  ons  accurate  y . rotwO  from  fh#  s.rge  f>«at  on  data 
d-scussed  above 

5?  and  P?  involve  the  percept  on  of  a*  mposs-De  crewing  wren  considered  three 
cJ.menson^'ly  Ho'e  -nonfrert  p»ofOcO's  nvO  v rg  tn.s  st-mu  i were  prev  OuS*y 
f)  r, cussed  with  regard',  to  t^e  'rfee-d ."■e"VO"a  enters  On  of  tne  programmed  sys’em 
One  th.ng  of  interest  n the  $ 2 sequence  tne  s^oe-ls  re-ance  upon  per  pne'a 

vsion  tor  tne  perception  of  nt.  bottom  cube  tne  *ront  face  of  tnat  c^oe  s never 
f «ated  Atfen!  0'  <s  p»  m^r,  y a rected  upon  tne  amog*o^s  face  and  edges  o’  tr  at 
cube  n an  apparent  attempt  a?  d-sampigua*  on  D'samo  gua*  on  s not  re  a- zed  As  w*tn 
the  ho  e movement  protoco  A P3,  tne  ^mo.gu  t / does  not  nte^ere  « tn  t*e  vefba  zed 
descr  ption,  but  does  cause  fne  drawing  procedure  to  have  proo'ems 

Eye  movement  seQuenc*  P2  has  oeen  a sp  eyed  on  two  pages,  P?(e)  and  P2lb) 
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P2U)  shows  the  first  twelve  eye-mOvement«  connected  by  dotted  tines,  the  (motion  12 
being  e very  long  (nation.  This  initial  eyemovement  sequence  mey  be  interpreted  ee 
related  to  the  behavior  which  produces  an  image  which  is  capable  ot  living  rise  to  the 
initial  segment  ot  the  verbal'ied  description,  bracketed  by  ‘a*.  Again  the  front  face  of 
the  bottom  cube  has  not  received  any  significant  (nation  attention.  This  intiel 
sequence  is  followed  by  ten  more  Inations,  these  connected  by  dotted  lines  in  P2(b). 
In  this  sub-sequence  the  bottom  cube  is  completely  scanned,  and  then  attention  is 
focussed  for  two  lc.g  Inations  along  tre  middle  line  of  the  upper  part  of  the  drawing. 
These  eyemovements  appear  to  bear  a correspondence  to  the  second  part  ot  the 
verbalized  description  bracketed  by  4b).  It  appears  that  the  subject  develops  two 
distinct  picture  representations  (perceptual  images)  here,  repining  the  inadequacy  Of 
the  ambiguous  description  for  drawing  purposes.  Again  evidence  of  the  pre-set 
cognitive  goal  (the  drawing  task  to  be  accomplished)  upon  the  perceptual  process  is 
demonstrated. 

Both  S3  and  P3  show  tnc  alternation  of  (nation  durehonsd  and  the  frequent  re- 
tinating  of  Object  interaction  areas.  An  initial  scan  of  the  complete  picture,  which 
appears  to  rply  heavily  upon  peripheral  indications  is  followed  by  a rescan  to  insure 
the  proposed  image's  correspondence  to  the  presented  drawing. 

Protocols  S4  and  P4  are  important  for  their  similarity  m the  use  of  peripheral 
vision  to  realize  three -dimensional  perceptions  In  both  instances  only  areas  of  the 
front  faces  are  (mated  The  three-d'm»nsionei  *lr  uer"  vertices  ere  Meted  and  the 
interaction  between  the  cube  and  sloped  plane  receives  the  en  pec  ted  consideration. 
Peripheral  vision  here  is  deemed  sufficient  by  the  assimilation -eccemcdetion  process 
as  a source  Of  facial  confirmation  mtermat'Cn. 
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Oh'>  geher»  CO *S'0e**%0-  *•*«  r>ee»“  I've*  •00'*  tc  TV  fy*-mOv#m*^  p'OtpCO't 
gtv^n  i*  tv  append  fc  Uc  "'£✓*  tv  -m©ve  oeic-.p t'O-  O’  f »pe»'»?0’’y  fewt*©*  < 
e’tempteo  "’►.**  tome  ije*  oe^-pton t *;>©e*'  POttO'f  •*  te'mi,  o‘  the  aktv.t.fi  o* 
the  o-©:ettet  an©  the  cogent*  ©*  *v  memo-vt  p-op©seo  fc>  the  thevt  •*  tv  oegre# 
o*  uccett  oet  rec  here  "'he  mte'e^tec  rfia*  it  o-geo  tc  co*t  ae>  the  •ppenp.ret 
♦jr*he',  es  tv  oet»  o'es-e^eo  n»*  **■*•>  v»^*t>*e  p©  m* 

"hjt,  ‘h'Ough  v otcu^t-o*  ot  the  *we  iooe^O'cet  o»  £*pe'»me*t  !i  oete  ’he 
p-orotee  o*  v •©'*  pe'cept*on  gethe't  tether  enecoot*'  or  .nte'e*’,* 

tjppoM  At  nd'cetec.  muc*  rese**c*  <t  veoec  to  g»the»  t^rthe'  o»t*  app.cepe  to 
the  ret  he^eht  ot  tucn  » theory  ot  vtu*  ^ege  vp-ete  *'•*%©*  *n©  percepiu* 
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Chapter  LS Conclusion 


This  chapter  considers  several  other  recent  studies  involving  the  memory  ot 
primarily  visual  concepts  and  discusses  these  proposals  in  light  ot  this  thesis.  An  m- 
deptn  discussion  o'  general  characteristics  ol  the  human  cognitive  representational 
system  follows.  Fina.'y.  several  suggested  directions  for  further  research  will  be 
noted  as  a conclusion  to  the  paper  presented  here 

1 Study  Comparison 

Any  cho.ce  of  studies  for  companion  n.ust  be  h.ghly  erelusive.  As  such,  three 
recent  studies  have  been  selected  to  be  contrasted  with  VIPS  All  three  involve  the 
use  ot  a symbolic  representation  of  visual  nformation  in  a computer-implemented 
s.mu  atiOn  of  cognitive  benevor 

BAYLCW'S  BLOCKS 

George  Baylor  (19711  proposes  that  an  image  representation  of  a cube  it  an 
integral  part  of  the  processing  machinery  involved  m the  solution  of  a block 
visualization  task.  The  subject  is  given  a painted  block  description  and  instructions  as 
to  no*  thus  block  is  then  cut  into  pieces  The  subject  is  required  to  answer  various 
questions  as  to  the  number  of  resultant  pieces  with  given  painted  conditions  (■*  how 
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many  have  ona  blua  fata*).  At  a result  ol  I ha  analysis  of  a varbal  protocol,  Baylor 
propotat  tha  eeistence  of  two  interacting  rapratantational  problam  tpacat  which 
bacoma  involved  in  tha  problam  tOlvir|  activity. 

"S-Spece"  (symbolic)  holds  trua  generalisations  (facts)  concarninf  blocks  and  alto 
is  usad  to  hold  an  ancodad  (parsad)  raprasantatior.  of  tha  question  to  ba  anavarad 
concerning  tha  segmented  block.  This  ancodad  ouastion  raprasantation  it  appliad  to 
tha  block  raprasantation  ol  ‘I-Space*  (imaga  tpacs)  by  availabta  matching  oparatora 
which  iocata  imaga  componants  tor  counting.  Fma.ly,  an  anawar  is  dapositad  w $• 
Spaca.  Thus,  S-Spacs  acts  as  a translational  buffer  mamory  batwaan  tha 

varbatitationa  and  imaga  raprasantation  (STM)  and  as  a semantic  component  of  long 
term  mamory.  Baylor's  proposal  it  admittedly  not  a completa  cognitive  modal. 

Tha  block  raprasantation  residing  in  I-tpaca  t hierarchical  in  natura.  This 
structure  reflects  tha  hierarchy  of  part  containment  (*  block,  to  faces,  to  edges,  to 
vertices).  As  tha  initial  block  is  segmented  according  to  the  proscribed  cutting,  other 
specialited  intermediate  hierarchical  groupings  become  applicable  and  are  usad  (i.e. 
corner,  border,  center  cubes).  At  the  bottom  level,  vertices  ere  interrelated  by 
spatially  meaningful  links.  Although  thesa  spatially  meaningful  links  are  incorporated 
into  Baylor's  image  (l-$pace)  representation,  this  information  appears  to  be  irrele  ant 
to  the  task's  solution  and  thus  also  to  the  model's  operation.  Tha  input  question  is 
parsad  into  a hierarchical  semantic  structure  which  than  serves  as  a goal  stack.  This 
hierarchy  of  goals  directs  the  altering  and  accessing  of  tha  hierechicol  cubic 
representation  found  m I -Space  Through  a matching  of  structure  schemas,  the 
relevant  information  is  obtained  end  placed  in  S -Spaca  as  the  answer  Thus,  though 
spatial  information  is  a part  of  Baylor's  image  representation,  it  is  not  put  to  significant 
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use.  Furthermore,  this  image  it  not  Kciuid  by  mem  related  to  thet  ol  ecce-sing 
eslernel  visual  information.  Thuc,  Baylor's  image  it  not  • visual  image  at  defined  in 
Chapter  LI.  Baylor’s  image  repretentation't  ttructure  closely  rettmblet  the  usual 
(hit)  encoding  of  verbal  mtormaton  1-Space  at  defined  does  not  merit  the  claimed 
separation. 

NEWELL’S  STIMULUS  ENCODING 

Newell  (1972)  develops  an  encoding  representation  for  colored  bottles.  He  then 
defines  several  associated  processes  which  prove  sufficient  to  accomplish  a visual 
senes  eatrapolation  task.  The  salient  features  for  determining  the  generating 
characteristics  of  the  series,  and  thus  for  proposing  the  neat  series  element,  are  the 
bottles’  orientations  and  colors.  Not  surprisingly,  the  representation  proposed  for  the 
visual  input  (and  memory)  of  each  bottle  is  merely  a list  of  just  these  features.  For 
ea ample,  "(OBJ  BTL  VT  BED)"  represents  a vertically  oriented , red  bottle. 

Newell  does  not  propose  a visual  image  representation  of  the  visuel  environment, 
even  though  the  information  source  is  spatially  structured  (the  series  is  presented  by 
a letl-to-right  row  of  bottles).  The  spatial  structure  is  representative  of  the  bottle 
sequence  m this  task.  A visual  image  representation  which  must  contain  spatial  and 
form  characteristics,  would  be  superfluous  to  the  subject’s  accomplishment  of  the 
given  task,  and  thus  is  so  for  the  inferred  syslum  also.  The  task  can  be  interpreted  as 
being  that  of  determimmng  the  bott>  sequence's  generating  syntes.  A representation 
whiih  is  processed  syntactically  has  been  appropriately  inferred.  This  representation 
does  not  satisfy  the  visual  image  definition  either. 

Taro  special  situations  which  are  encountered  by  Newell’s  system  during  solution 
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of  the  task  indicate  the  applicability  of  an  assimilation-accomodation  process.  Newell 
proposes  e constant  hierarchy  of  feature  relevancy  from  an  analysis  of  subject 
verbalizations  on  twenty-three  senes  estrapolations.  This  hierarchy  determines  the 
order  of  features  as  acquired  on  input  and  as  subsequently  considered  in  determining 
the  generating  syntax  of  the  series  This  constant  hierarchy  leads  to  several 
erroneous  series  proposals  by  the  implemented  system. 

The  implemented  system  also  encounters  trouble  in  achieving  the  Overall  series 
organization.  Newell  says,  Thera  must  be  a delay  m actually  organizing  the  perceived 
sequence,  since  subsequent  objects  have  not  yet  been  observed  and  they  may  aftect 
the  organizetion*  (p  20.  When  encountering  two  type  bottles  lor  input  (X  and  V)  ard 
the  first  four  are  as  XVXY,  the  system  prematurely  organizes  them  as  ( (X  Y)  <X  V)  ).  If 
another  XV  pair  is  encountered  the  final  senes  structure  will  be  ( < (X  V)  <X  V) ) (X  V)  k, 
which  is  inappropriate.  Newell  discusses  and  implements  further  processes  to  perform 
the  necessary  reorganization  as  ( (X  Y)  (X  Y)  (X  Y) ). 

These  problems  relating  to  feature  relevance  and  overall  sequence  organization 
are  symptoms  of  the  proposed  system's  failure  to  use  ousting  STM  contents  as  the 
source  of  organization  and  expectations.  The  most  relevant  stimulus  feature  (or 
features)  is  not  chosen  on  the  basis  of  a static  hierarchy  of  relevance.  It  is  (should 
be)  chosen  on  the  basis  ot  the  currant  representation  of  the  series  in  STH  the  current 
context.  The  partial  series  image,  as  represented  m an  intermediate  STM  stole,  is  also 
used  to  propose  expected  overall  scries  organizational  characteristics.  Any  current 
regularity  of  the  incomplete  input  serves  to  suggest  a structural  representation  of  the 
complete  input.  This  proposal  provides  expectations  and  determines  feature  relevance 
with  regards  to  ths  newly  lusted  input.  An  assimiletion-eccomodation  process  con 


then  operate  to  not*  consistency  ot  n»w  inputs  with  *>pectat>ons  and  accordingly 
•Had  alterations,  general*  new  proposals,  and  determine  new  'nature  relevancies  at 
necessary. 

For  e« ample,  given  XYXY  the  process  constructs  an  Overall  series  representation  ot 
( (X  Y)  (X  Y)  (X  Y)  ) prior  to  the  input  ot  the  last  two  eements.  No  ‘delay"  is 
necessary,  as  Newell  proposes.  Instead,  stimulus  encoding  (perception)  entails  early 
(hypotneticaD  structuring  which  facilitates  subsequent  assimilation  - accomodation. 

MORAN'S  PATH  IMAGE 

In  another  recent  proposal,  Moran  (1973)  develops  a representation  to  account  for 
observed  subiect  verbalizations  during  a path  imaging  task.  The  representation 
developed  there  is  again  hierarchical  m nature  (as  Ba/lor).  The  sequence  Of  line 
segment  inputs  eaists  at  the  bottom  level  ot  the  structure,  with  an  organizing  structure 
of  visual  concepts  developed  Over  th,s.  The  structure  is  used  as  the  basis  (means)  for 
the  "chunking"  of  information.  A smgl*  symbol  of  the  hierarchy  in  STM  is  capable  of 
representing  and  activating  (raca'lmg  into  STSA  if  necessary)  all  of  the  elements  which 
are  below  it  in  th*  structure 

Several  task  requirements  are  agan  particular^  relevant  to  the  design  of  that 
proposal.  The  sequence  Of  line  segments  to  be  imaged  retains  importance  throughout 
the  task.  Indeed,  the  task  is  stated  m terms  of  "imaging  a path",  not  a picture  (line- 
drawing).  The  line-segment  elements  ot  the  path  are  determined  randomly.  Thus,  th* 
subject  has  no  enpectetton  that  a coherent,  easily  recognizable  path  would  be 
presented.  Actually,  th*  opposite  characteristic  (of  pith  randomness)  is  probably 
naturally  assumed.  As  such,  this  appears  to  have  inhibited  dependence  upon  object 
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expectation  proposals  and  forces  the  subject  to  develop  a conservative  image 
representation  at  all  times.  Partial  objects  ara  actually  mora  to  bo  espected  than 
completed  a not  This  yields  a hierarchic  raprauntation  m tarns  ol  realized  parts 
similar  to  Baylor.  Randomnats  doot  not  pravant  aipactations  'Faldnan,  1961),  but  in 
this  case  it  mtroducas  a ra admass  lor  partial  concapt  raprasantation  as  a usatul 
available  contingency. 

Soma  difficulty  eaists  as  to  the  representation'!  ability  to  realize  inferences  based 
primarily  upon  spatial  (locational)  interrelationships.  This  results  from  not  including 
locational  symbols  in  the  image  raprasantation.  The  scarcity  of  protocol  evidence  of 
such  inferences  allows  the  inefficient  (not  straight  - forward)  implementation  of  tiiese 
inference  realizations.  In  the  protocols  of  this  thesis,  inferences  based  upon  locational 
relationships  occur  frequently.  As  such,  thi  visual  mage  is  bound  to  a framework  of 
locational  (positional)  symbols  which  errata  an  imagmal  space 

REPRESENTATION  COMPARISON 

Behavior  on  three  tasks  involving  the  representation  of  what  is  primarily 
considered  to  be  visual  (or  visual  image)  information  yields  three  fundamentally 
differing  proposals.  In  two  tasks  (Newell,  Moran),  the  sequence  Ol  inputs  retains 
importance  and  is  carefully  imbeddeo  nlo  the  memory  structures.  In  two  tasks  (Moran, 
Baylor),  partial  concept  representations  (due  to  cutting  of  a cube  or  expected, 
frequent  incompleteness)  are  of  importance  and  a hierarchical  structure  reflecting 
component  part  subordination  is  proposed  Two  proposals  attempt  to  fully  represent 
the  cognitive  processor  (Newell,  Moran),  and  their  visual  representations  reflect  a 
concern  for  STM  reseerch.  None  of  the  three  visual  representations  satisfy  the  visual 
image  definition  of  Chapter  M. 
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In  iKh  study,  the  task  determines  whit  features  and  relations  ot  the  visual 
information  ara  necessary  lor  the  successful  accomplishment  of  its  requirements.  The 
visual  modality  factor  appears  to  have  had  much  less  effect  upon  the  form  of  these 
three  proposals  than  do  other  task-related  considerations.  The  task  of  this  thesis, 
being  the  realization  of  a perception  of  a given  line  drawing  has  likewise  resulted  in 
another  differing  proposal  lor  the  symbolic  (cognitive)  representation  of  visual 
information.  In  this  case  the  modality  factor  is  the  primary  task  feature.  This  has 
resulted  m e representation  satisfying  the  visual  image  definition. 

2.  Flembility  of  Representation 

Behaviorists  have  long  attempted  to  realize  a parsimonious  theory  Of  humen 
internal  information  representation.  They  propose  that  all  internal  representation  is  in 
the  form  ot  mental  words  Associahonists  have  also  been  in  this  fight.  Recent 
proposals  state  that  an  memory  is  realized  m the  form  of  concept  - relation  based 
hierarchical  structures  (Kintsch,  1972;  Bower  and  Anderson,  1973). 

In  contrast,  it  >s  proposed  here  that  the  representational  aspect  of  human  cognition 
is  a very  flembie  aspect  The  apparent  need  tor  concise  representation  within  our 
limited  operational  or  active  memory  precludes  the  development  of  a parsimonious 
theory  Of  human  information  representation  consisting  ot  a Single  or  several  satisfying 
universal  of  form  end  content  The  ability  to  fit  the  active  information  representation 
to  the  goals  at  hand  <s  proposed  as  being  the  primary  characteristic  of  the  human 
representational  system  As  George  Miller  has  said  : 

“it  seems  to  me  that  me  very  tact  of 
Our  limited  capacity  tor  processing  nformahon 
has  made  it  necessary  for  us  to  discover  clever 
ways  lo  abstract  fhe  essential  features  of  Our 
universe"  (G.  A Miller,  1967,  p4J) 
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LANGUAGES  OF  ART 


The  discussion  to  follow  relates  thi«  proposal  la  a most  interesting  treatise  on  Iho 
roprotonlolions  and  aourcos  Of  moaning.  If  it  a boos  by  Notion  Goodman  (IMS)  cal  lad 
Languages  of  Art.  In  I ha  book  ha  aaaclly  datinas  a sol  Of  farms  and  proceeds  to 
extensively  compare  and  interrelate  these  into  a coherent  system  of  meaning  Sevprai 
such  terms  and  their  interrelationships  are  relevant  to  this  attempt  at  describing  the 
selectivity  of  representation  which  is  proposed  here.  Though  Goodman  writes 
primarily  to  explain  the  representative  power  of  art,  the  concepts  which  he  develops 
are  useful  to  the  understanding  of  human  cognitive  (internal)  representation. 

An  object  of  tha  environment  'possesses*  all  of  those  properties  for  which  the 
corresponding  predicate  applies  ano  is  true.  Thus,  m Figure  VL1,  object  0 has 
properties  AJJ£,D  Those  true  predicates  (ie.  "HAS  A*)  apply  to  tha  object  from  the 
property  as  a meaningful  reference.  An  object  necessarily  eaemplifies  all  true 
properties  which  apply  as  opposite  directed  references.  An  object  symbol  (or 
representation)  possesses  all  properties  of  the  object  which  it  represents.  (Soe 
Figure  /I2.)  An  object  symbol  may  furthermore  exemplify  any  property  which  it 
possesses.  As  Goodman  puts  it,  'Exemplification  is  possession  plus  reference*  (p  53). 
In  Figure  VI.3,  object  symbol  0 exemplifies  only  propei ' es  A and  B of  those  which  it 
possesses. 

Goodman  says  that  'just  which  properties  of  a symbol  are  exemplified  depends 
upon  what  particular  system  of  symbolization  is  m effect  * (P53h  and  further, 
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"Ettablishment  ot  the  referential  relationship  it  t matter  of  singling  Out  certain 
properties  for  attention,  Of  selecting  associations  wth  certain  other  objects"  (p88>. 
Putting  thtta  two  statements  togothtr,  certain  properties  that  art  possessed  by  an 
object  will  b«  ot  interest,  which  propartiat  ara  eiemplified  by  tha  chotan  object 
tymbol  (rapratantation).  n associated,  particular  system  of  symbolization  will  ba  n 
affact  at  a ratuit. 

In  tha  thraa  comparativa  studies,  and  m this  that't  ittalf,  tha  lath  laadt  sub,ects  to 
datarmna  which  propartwt  of  tha  mvolvad  vitual  information  ara  necessary  for  its 
tuccattful  complation  Tha  fata  determines  which  propartiat  receive  attantion  and  ara 
aiamplifiad  by  tha  mamory  representations.  A tyttam  at  symbol  i tat  ion  ratullt.  For 
aaampla,  only  tha  propartiat  of  color  and  orientation  ara  aiamplihad  by  tha  bottla 
Objact  rapratantationt  of  tha  symbolization  tyttam  propotad  by  Nawoll  (taa  Figura 
VIA) 

Goodman  defines  tha  useful  concept  of  "representation-es*.  Th.t  term  diffart 
from  just  plain  ‘rapratantation*  While  "representation"  involves  solely  an  operation 
Of  denotation,  "repretentation-et"  involves  ooth  denotation  and  classification. 
Classification  it  selectivity  o'  eaempiiticetion.  Thus,  classification  naturally  altart  the 
form  of  rapratantation  as  shown  by  tha  study  enamptet.  Tha  human  ability  to 
'rapratant-at',  which  it  wall  demonstrated  by  artists'  accomplishment t as  noted  by 
Goodman,  it  eaectly  tha  fle»biiity  of  representation  which  it  being  proposed. 

In  the  vitual  image  rapratantation  propotad  by  this  thesis,  a block  it 
"represented -at*  a sat  (structure)  of  interrelated,  non-tuerarchic,  facial -projection 
repreten  ations  (image  chunks).  This  form  of  symbolic  representation  facilitates  vitual 
recognition  and  processing  as  hat  been  discussed  A comples  hierarchy  ot  object 
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(blocs'  ports  <es  Beylor)  conte-ns  unnecessery  nforn-r'  eno  t wrong  y structured 
*0'  ef*  c ent  use  Oy  th»  suet  processor. 

As  Guv-  on  predicts,  the  system  ot  symbol.iet'Ox  wh.cn  hoe  beer  nterred  to 
eccount  for  the  observed  sub  eel  bohewor  on  the  tests  of  ee<n  study  df*er 
s.gniticentty  from  »Kh  other  Ve!  etch  hferred  representet  or  edeoutte  y emooaes 
the  hformet'Oh  when  is  suff'C’pnt  for  the  eccomp.  shmeni  ot  t"e  g vex  tes«s  >steed 
of  pu’su  n|  »n  prgumext  of  contact  here  ts  to  when  propose'  'S  close'  to  tM  context 
exp  form  of  e 'universe'"  representetipn  ( moge)  o'  vituel  .ntormet'O",  1 e'e.*  met  eil  of 
these  stuaet  serve,  m concert,  ts  .x.t.e  results  support  ng  e genero  theory  ot 
'epresontetionei  llonbitity. 

a theory  of  cognition 

Whre  Goodmex's  sets  hev#  mer,t.  ho  does  no-  soy  enough  He  does  not  ettempt 
to  describe  me  cogM-ve  system  wn.cn  *Hei  post  be  t"e  use  o'  the  represextet.oxe 
eb't'tioe  which  ho  proposes.  He  does  "Ot  oo  tns  ot  xe  r.»t  other  gjes  The  goo'  o* 
the  thesis,  on  the  other  hexo.  s eeoctiy  to  oesc'be  sue"  ex  ose'etive  cognitive 
system  Therefore,  txe  fo'  owixg  theory  i«  presented  The  theory  e*bodeo  oy  VI 
s e spec  f c .nstentieton  ot  ms  ge»e'e'  theory  o‘  cogx  t on.  I'deed,  txe  tpeetcet  0" 
o*  e tneo'y  0*  eny  c ess  of  cogx.ton  must  be  grounded  ,n  on  ove'e  i tneo'et'ce  bet  s 
of  el'  COghit  on 

The  bets  of  e cognt  on  s representetioxe'  *now  edge  bepresextotiOne 
hnowledge  it  ex-boded  by  iO"g  te’m  «e«0'y  i.o«g  term  memory  s e compiee 
eementic  structure  of  symoo's  exo  reiotions.  A sy»eoi  is  e node  m the  xetwo  s-ti»e 
long  term  memory  structure  A reiet  ox  s e directed  connection  between  two  two 
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symbol*.  Being  a semantic  Structure  lon|  term  memory  is  * representation  of  moaning 
The  moaning  of  a symbol  or  raiation  it  defined  by  (to  bt)  its  location  within  the  long 
term  memory  structure.  Relations  are  always  pairad.  A par  of  relations  is  said  to  bo  a 
property  o<  the  symbol  from  which  both  relations  originate  One  relation  of  the 
property  pair  references  a symbol  which  labels  the  lint  between  symbols  which  the 
other  relation  constitutes.  A symbol  is  smpy  a group  of  relational  properties.  A 
symbol  may  be  connecteo  oy  relations  to  communicable  components  of  a language- 
based  substructure  Of  long  farm  memory  which  allow  its  eiternal  expression.  A 
symbol  may  also  be  connecteo  fo  components  of  the  various  modal  ty-specific 
perceptual  systems  whicn  allow  it  to  b*  used  in  tne  perceptual  act  vity  and  to  be  an 
element  of  the  resultant  perception. 

The  symbols  and  relations  of  cognit.on  are  phys>caliy  embodied  in  the  structure 
and  the  patterns  Ol  activation  o'  the  neurons  ot  the  b'*>n  Bram  neuron  act.vity  can 
be  (is)  effected  by  the  activity  ol  tne  compete  central  nervous  system.  Human 
behavior  not  mvolvi-g  the  use  of  symbolic  representation  is  not  cognition.  For 
eeample,  simple  reflee  actions  (i*  >nee  .era  r*f(*«)  appear  to  be  based  solely  upon 
lower -order  nerve  cell  states  a one  (sensory,  motor,  and  sp.nai) 

The  symbols,  relations,  and  structure  of  long  term  memory  develop  as  the  product 
of  the  organism's  (person's)  continuous  attempt  to  adapt  to  (represent)  its 
environment.  The  process  of  representational  adaptation  is  an  evolutionary  process 
As  such,  long  term  memory  is  a function  of  an  mnats  initial  state.  0*  innate  potentials, 
and  of  the  history  of  its  involv-menl  in  all  cognition.  Due  to  the  evolutionary 
character  of  long  term  memory,  the  existence  and  meaning  of  any  symbol  is 


necessarily  semi-permanent. 
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To  adapt  to  an  environment  it  to  bo  capable  Of  effecting  successful  (adequate) 
behavior  within  thot  environment  At  tho  botit  Of  cognition,  long  form  memory  mutt 
represent  not  only  on  environment  but  *lto  the  meant  of  responding  to  end  acting 
upon  that  environment.  Therefore,  cognitive  processes  ere  Ihemtelvet  structures  of 
symbols  end  relations  that  ere  part  of  long  term  memory  To  be  operative,  cognition 
has  one  requirement  esternei  Ic  long  term  memory.  Cognition  requires  a systematic 
cycle  of  long  term  memory  activation  and  interpretation,  it  it  this  that  life  and  tune 
provide  (or  are). 

As  processes  are  embodied  witnm  long  term  memory,  it  is  both  the  means  and 
product  Of  its  Own  evolution  Long  term  memory  evolves  by  the  action  of  three 
process  types  The  processes  of  remembering  incorporate  selected  environmental 
factors,  created  by  other  task-related  processes,  into  the  long  term  memory  structure. 
Developmental  processes  determine  the  state  of  availability  of  innate  potentials. 
Learning  processes  alter  long  term  memory  in  three  ways.  One  is  the  alteration  of 
evstmg  symbol  end  relation  meanings  by  the  addition  of  new  r.'ations  which 
restructure  of  long  term  memory  Two  is  by  the  creation  of  new  symbols  and  the 
incorporation  of  these  into  long  term  memory  The  third  is  by  developing  active!  abe 
structures  as  ru'es  and  environmental  factors  suited  to  the  eipected  tasks. 

At  any  point  in  tune  (during  any  cycle  of  activation  and  interpretation)  only  a small 
traction  Of  long  term  memory  is  active  or  selectively  attended  The  active  memory  is  a 
representation  of  current  conleit.  Active  memory  consists  of  a set  of  environmental 
factors  end  an  active  rule  of  a cognitive  process  (the  active  process).  The 
environmental  factor  is  the  unit  of  contextual  environment  representation.  The  rule  is 
the  unit  of  cognitive  process.  As  a part  of  long  term  memory,  the  environmental  factor 
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end  the  proem  rule  ft  both  structures  ol  symbols  and  relations  To  detine  »n  active 
representational  system  (eg  vi«u*l  imagery)  is  to  specify  tho  symbols,  th#  rolotiono, 
end  I ho  itfucturo  typot  which  constitute  its  units  ol  activstion  (environmental  lectors). 
To  dotino  * cognitive  procots  is  to  do  tho  seme  tor  its  rules. 

Tho  sot  Ol  environmental  lectors  which  aro  ICtivo  *t  sny  point  in  time  constitutes 
tho  er, /ironmental  contort  tor  tho  octivo  rulo  during  (hot  eye  to  ol  octivotion  ond 
interpretation,  Each  active  environmental  lector  plays  a process-related  function  onu, 
as  such,  is  said  to  bo  (bo  m)  a certain  component  ol  active  memory.  Tho  possible 
(unctions  a re  defined  by  and  oust  with  regards  to  the  active  process  rule.  General 
characteristics  ol  the  structure  and  content  ol  an  active  environmental  lector  are 
determined  by  the  functional  row  it  plays.  Thus,  a Currently  active  rule  determines  the 
general  nature  Of  its  representational  environment.  Cognitive  processes  Oust  on  the 
basis  ol  a task  to  be  accomplished  (adequate  behavior).  As  such,  general 
characteristics  ol  the  current  environmental  representation  are  indirectly  related  to 
the  current  task. 

The  twaibility  Of  the  environmental  representation  to  Sint  the  current  contest  to 
the  task  at  hand  is  necessarily  restricted  and  imperfect.  At  any  time,  IWnbility  is 
bounded  at  the  extreme  by  the  currently  available  symbols,  relations,  and  structure  ol 
long  term  memory.  The  tWnb'iity  is  a'so  limited  by  the  evolutionary  state  Ol 
sophistication  ol  the  active  rules  (processes)  which  become  involved  m the  task 
solution.  The  state  ot  process  sophistication  and  specialisation  is  itself  inversely 
affected  by  the  symbols  and  relations  which  are  avaiiabW  lor  activation  as  rule  or 
environmental  lector  contents.  The  state  0*  Organism  development  determines  the 
availability  of  innate  potentials  which  also  attest  the  range  ol  llesib<iity  Selectivity  el 
activation  is  the  operational  equivalent  of  Goodman's  selectivity  ol  eeemplilication. 
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upon  I ho  commencement  of  each  cycle  of  activation  and  interpretation,  < rule  *nd  • 
sol  of  environmental  f acton  sro  activated  by  selective  attention.  The'*  are  several 
general  criteria  which  determine  this  selection.  The  rufo  s selected  on  the  bests  of 
the  currently  ect  ve  process  (e  partition  of  the  cognitive  rules)  end  on  the  bests  of  the 
contents  of  environments!  factors  which  have  been  active  during  the  immediately  prior 
cycle  (primarily)  or  during  one  of  the  past  several  cycles  (recently  active).  The 
environmental  factors  which  are  activated  initially  are  determined  m conjunction  with 
the  rule  selection.  They  are  a selection  from  the  recently  active  environmental  factor! 
which  determine  the  rule  selection  and  which  are  therefore  activated  to  play  functional 
rolos  with  regard  to  the  selected  rule.  Ounng  the  cycle  of  activation  and 
interpretation,  further  symbols,  relations,  end  even  environmental  factors  may  be 
activated.  This  selection  is  determined  by  the  active  ruie  and  by  the  meanings  of  the 
already  active  environmental  factors. 

An  active  rule  or  environmental  factor  remains  effectively  imbedded  m the  Overall 
long  term  memory  structure,  thus  facilitating  activation  of  any  closely  related 
Knowledge.  The  recently  active  environmental  factors  and  the  long  term  memory 
closely  related  to  the  currently  active  memory  constitute  a readily  activatable  fringe 
of  consciousness*.  As  the  phenomenolegist  Husserl  states,  f he  focal  is  girt  about  with 
a >0ne’  of  (ho  marginal  * (Husserl,  1N2,  plOT). 

Perception  is  the  class  of  cognition  which  is  the  active  interpretation  by  the 
organism  of  the  state  of  a subset  of  its  ceils.  The  ceils  which  are  interpreted  are 
either  a part  of  or  have  a direct,  effective  im*  with  the  organism's  surface.  In  an 
organism  of  sufficient  compienty,  these  cells  are  modality-specific  sensory  receptors. 
The  status  of  the  sensory  receptor  cells  is  the  one  further  determinant  of  the 
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selective  activation  ot  environmental  factors  which  occurs  during  perception.  An 
active  rule  of  a perceptual  process  can  activate  new  environmental  factors  on  the 
basis  ot  currently  active  environmental  factor  meanings  and  the  states  of  selected 
receptor  cells  or  recepto  cel  combinations  (receptive  fields).  The  result  of  this 
interpretive  activity  is  a symbolic  representation  which  is  constructed  as  an 
interrelated  group  of  environmental  factors 

Conscious  experience  at  any  point  in  time  .s  the  internal  phenomenon  which 
accompanies  (results  from)  the  activation  and  interpretation  of  the  active  rule  and 
environmental  factors.  Conscious  experience  is  not  the  contents  ot  active  lemory.  It 
is  not  the  active  and  causal  "stutt*  ot  cognitive  behavior  Out  is  merely  the 
epiphenomenal  creat  on  o'  that  benavior.  This  is  not  to  oen  that  conscious 
experience  may  itself  form  a domain  of  representational  Knowledge  in  long  term 
memory  The  activation  of  any  part  ot  that  representation  in  the  context  of  an  active 
rule  end  other  environmental  factors  will  necessarily  result  in  a conscious  experience 
wh.ch  differs  from  the  original  (that  represented). 

Conscious  experience  is  related  to  the  meanings  ot  the  symbol  structures  of 
active  memory.  Differences  between  conscious  experience  have  two  sources.  One  is 
an  actual  ditfe  ence  in  the  contents  ot  active  memory  (in  terms  ot  activated  symbols, 
relations,  and  structures).  The  other  is  that  the  meanings  o'  the  activated  long  term 
memory  elements  have  been  altered  by  the  intervening  evolution  of  long  term  memory. 
Due  to  the  changes  of  symbol  meanings  which  accompany  this  evolution,  it  may  not  be 
possible  to  recreate  (reexpenence)  a conscious  event  even  though  the  contents  of 
active  menory  are  identical  with  that  of  the  past  experience. 
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PSYCHOLOGICAL  INDICATIONS 

A study  by  Trabasso  and  Bowar  (1968)  illustrates  lb*  flexibility  of  active 
memory  or  the  selectivity  ol  "representation-as".  T,  ey  presented  subjects  with  cards 
showing  four  letters  in  a row.  The  task  given  was  to  sort  the  cards  into  two  piles  on 
the  basis  of  the  second  leter  being  L or  B,  tor  erample  In  learning  trials,  letters  were 
randomly  paired  with  L and  B in  the  other  positions.  In  further  trials  following 
learning,  the  letter  m the  fourth  position  was  consistently  paired  with  the  second 
position  (ie  D with  L,  E with  B)  During  these  trials  the  subjects  were  required  lo 
recite  all  letters  wnile  sorting  the  cards  on  the  basis  of  the  second  position  as  before. 
Following  this  test,  trials  were  given  in  which  the  second  position  was  left  blank  (no  L 
or  B>.  No  subject  could  correctly  sort  the  cards  even  though  the  letters  in  the  fourth 
position  (D  or  E)  were  shown  ind  could  serve  as  a basis  for  sorting  Thus,  see  ng, 
recognizing,  and  verbally  repeating  the  letters  did  not  ensure  (cause)  selection  of  the 
letters  in  the  fourth  position  as  a part  of  the  active  environmental  factors  upon  which 
the  action  of  the  active  rules,  and  thus  beh«-  was  based. 

Recent  research  in  cognitive  oschology  has  begun  to  provide  evidence  (and 
proposals)  for  the  multiplicity  of  internal  information  representation.  Tversky  (1969) 
has  produced  results  which  indicate  the  ability  of  subjects  to  represent  the  same 
stimulus  in  visually  and  verbally  determined  structures  m STM.  The  mode  used  reflects 
task  requirements  and  thus  indicates  flembility  Peivio  (1971)  also  presents  results 
indicating  the  use  of  both  visual  and  verbal  memory  representations  as  mediators  m 
association  and  recall  tasks. 

The  human  ability  to  produce  an  internal  representation  which  represents  things 
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as  15  necessary  or  sufficient  lor  the  task  at  hind  >5  mail  vi'uiDe  A'  with  any 
orgamsmic  characteristic,  this  ability  15  only  in  innate  potent.*1  It  m predicted  that  i 
person  without  a Henbia  representation*  system  may  not  perform  as  we  on  some 
tasks.  Such  tasks  which  do  not  easily  conlorm  to  the  » regular  mode  0*  representation 
may  prove  difficult  or  insurmountable  Lieberman  U9??  Ca'r  ed  Out  a study  involving 
a task  which  requires  mental  imagery  Ic  a cubei  n coordination  with  sequentia  goal- 
directed  behavior  to  solve  a Inree  dimensional  maze  Pre  erperimental  tasks  were 
conducted  to  classify  people  as  beng  good  spat  a imagers,  good  verbal  representers, 
or  both.  Preliminary  results  indcate  that  having  both  abilities,  thus  representational 
tleiioility,  shows  pos  live  correlation  to  the  degree  of  success  realized  on  the  complen 
maze  t»sk.  These  findings  are  not  Over  a statistically  significant  base  and  thus  are 
only  preliminary. 

Two  other  recent  stud.es  appear  to  indicate  representational  fiembility.  Frost 
(1971)  showed  sublets  line  drawings  which  varied  both  m spatial  orientation  and  in 
semantic  category  The  instructions  led  the  subjects  to  e»ped  either  a recall  or 
recognition  test  following  the  initial  learning  period.  Tests  were  conducted  to 
determ, me  if  the  instructions  had  affected  memory  organization  (representation).  The 
results  indicated  that  they  had  loltus  (1971)  conducted  a similar  comparison  and  had 
similar  results  for  a task  involving  continuous  paired  associates. 

RELATED  PROPOSALS 

Horowitz  (1970)  has  proposed  Ihrpo  basic  modes  of  memory  representation.  The 
"inactive"  mode  is  used  to  represent  actions,  esemplitymg  features  Of  direction  and 
force.  The  ‘mage*  mode  is  used  to  represent  spatial  information.  The  lenical*  mode 


cO"*  sts  of  gramma's  which  can  represent  sentences  (language)  and  sequential 
"formation  in  general  Theta  mooes  are  derivatives  of  the  'enactive*,  "conic",  and 
"symoo'c"  f"Odet  w"  cn  "ad  Been  desc*'Sed  by  Bfu«er  U964). 

Bated  upon  a Survey  Of  re'eva"!  phyS'O'oj  ca  and  neurological  research,  John 
(;96’i  oropotet  the  ei  stance  of  two  representational  system  classes.  The  'specific* 
system  s tied  to  sensory  (stimulus  ■ DOuno)  activity  at  are  PIC  and  VI  (iconic  memory) 
of  VIPS.  The  genera'  system  ret  ects  reset  t ve,  successful  activity  not  direct  y t ed  to 
sensory  input  (eg  RlTM  and  iTM  of  VIPS).  A spec  fiC  system  may  mlerract  with  a 
general  system  during  certain  benavio*  tie.  perception  oy  VIPS). 

With  the  return  o'  COmplei  ntema  representation  to  credibility  from  it!  long 
period  of  losing  battles  with  behavior  sm,  researcn  has  produced  several  boohs  dealing 
With  the  applicability  0»  varOuS  information  representations  to  teens  0*  tr>d 
environment.  Visua1  Th.nvng  ey  Amhem  (1971)  attempts  to  describe  tne  as  ites  of 
visual  imagery  and  ii  ust'stes  ’s  appa'ent  use  by  interest  "g  eiampies.  Sepenencos  n 
V£uel_Thmlun|  by  Mc<im  (1972)  presents  the  reader  w th  a senes  of  tasns  to  be 
performed  us>r-g  imagery  representations  and  dscusses  the  eoperent  appiicao  ty  of 
this  mode  of  represents!  on  to  mese  S^ecbcs  by  Gordon  (1961'  discusses  tne 
applicability  of  "representation  by  analogy"  to  the  solution  o*  'ether  compel  creative 
(eng  neermg)  tasns.  In  The  image  o*  the  C«ty.  lynch  (19(0)  investigates  the  nature  of 
people’s  memory  representations  o*  cites  ana  dvcusses  its  relevance  to  future  city 
design.  Oaude  Lev  -Strauss  dscusses  the  nature  o'  culturally  based  totemic  symbol 
structures  and  the  forces  which  cause  meir  alteration  m tus  boon  The_5avaje_Und. 


THE  ROLE  OF  REPRESENTATION 


Thu  them  proposes  thet  the  symbolic  representation  or  image  ot  any  body  ol 
information  is  used  to  guide  behavior  with  regards  to  that  information.  Behavior  at  a 
global  O'  'tr3tegic  level  <s  based  upon  the  structural  characteristics  ot  the  information 
representatiO'  being  employed.  The  local  (actual)  'values*  of  the  information 
structure's  elements  determine  the  behavior  at  the  tactical  (specific  stutional)  level. 

The  structural  characteristics  of  an  active  representation,  the  types  of  relations 
and  symbols  employed,  are  fundamental  m determining  the  classes  of  inferences  the 
cognitive  processing  system  can  realize  These  readily  available  inferences,  proposals, 
or  expectations  are  m turn  fundamental  detarmmants  of  behavior.  The  inferred 
representational  structures  of  th.s  thesis  (and  the  others'  do  not  only  embody 
efficiently  the  information  relevant  to  the  task  given.  They  also  determine  what 
inferences  may  be  easily  made  concerning  that  information  and  serva  to  guide  (shape) 
the  behavior  at  the  strategic  level 

Computer  science  research  ras  investigated  and  demonstrated  the  important  role 
of  information  representation  in  the  accomplishment  of  a given  task.  Indeed,  anyone 
who  has  done  any  computer  programming  at  ai  soon  becomes  aware  ot  the  important 
function  of  information  representation  Various  representations  have  been  formally 
studed  and  shown  to  have  important  effects  upon  the  efficiency  (lime)  ot  program 
operation,  upv*  the  amount  o'  memory  space  required,  and  even  upon  the  ability  to 
successfully  comple’e  a given  task.  These  results  have  appeared  in  the  area  ot 
artificial  intelligence  (Amaral,  19681  and  in  ihe  computer  science  discipline  in  general 
(Knuth,  1 961). 
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3.  Future  Research,  Conclusion 

All  aspects  Ot  visual  perception,  imagery,  and  information  raprasantalion  require 
further  investigation.  If  any  progress  can  be  said  to  be  made  by  any  study  now,  it  is 
that  the  study  suggests  or  begins  to  delimit  areas  for  future  experimentation. 
Experimentation  is  most  fruitfully  earned  Cut  in  light  of  an  ensling  theory.  This  serves 
to  generate  questions  and  hypotheses  (guides  behavior  at  the  stalegic  level).  Though 
subsequent  experimental  results  may  eventually  lead  to  the  theory's  final  discredit,  the 
theory  will  already  have  proven  its  value  as  the  source  of  investigation,  of  new 
knowledge,  and  Of  the  associated  ‘scientific  revolution*  (Kuhn,  1982). 

This  outlook  is  at  odds  with  the  recent  statement  by  R.  E Shaw 

"To  a theonst  B,  mach  ne  Ax  is  a mode  of  a 
psychological  phenomenon  A to  the  extent  that 
9 can  use  Ax  to  answer  questions  that  interest 
him  about  A * (Shaw,  1971,  p ) 

This  is  not  my  underst  snd.ng  of  scene*.  Rather,  a mach  »-  - ’ model  to  the  extent 
that  it  generates  interesting  questions  and  provides  hypothetical  answers  against 
which  empirical  results  can  be  compared  and  in  light  of  which  empirical  results  may  be 
interpreted.  A machine  is  also  a model  to  the  extent  that  it  can  be  altered  (can  evolve) 
to  account  for  subsequent  conflicting  indications  which  do  not  merit  rev'  ‘ ;n*ry 
measures. 

By  providing  a needed  and  well  specified  theory  of  visual  form  imagery  and 
perception,  this  thesis  can  serve  as  a significant  source  of  research  ideas.  The  theory 
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has  the  b«t»ng  of  lb*  local  data  trom  wn.cn  it  hat  bean  inferred  Alto,  at  indicated  in 
earlier  chapters,  the  attempt  hat  been  made  to  make  the  inferred  processing  tyttem 
consistent  with  external,  relevant  ptychoiogical  retearch  and  to  explain  the  vituel 
perception  and  imagery  phenomena  observed  therein. 

In  termt  of  general  cognitive  tyttem  charKtenttict,  further  memory  retearch  it 
necettary.  Further  STM  (active  memory)  retearch  with  vitually  pretented  ttimuli  that 
are  not  iutt  lettert  or  worot  which  trantfer  eatily  to  equivalent  verbal  codet  it 
neeoed  to  help  determine  the  amount  of  information  retainable  and  to  gain  further 
ideas  concerning  its  possible  representation  Further  retearch  it  needed  to  better 
determine  tne  structure  and  operating  characteristics  of  recognition  long-term 
memory.  To  answer  such  questions  at,  "What  partial  information  it  sufficient  to 
suggest  an  object's  existence  (recognition)**;  "How  easily  can  new  objects  for 
recognition  be  entered  and  how  it  this  accomplished**  *!t  the  operat  *n  of  RlTM  serial 
(sequential  traversal  of  a decision  net,  as  proposed  here)  or  parallel**  further  results 
are  needed 

Active  experimentation  is  a‘so  suggested  w.tn  regards  to  the  determination  of  the 
existence  and  characteristics  of  an  intermediate  term  memory  This  memory  has  been 
proposed  here  as  it  nat  proven  useful  m accounting  lo-  the  observed  behavior  There 
■s  st  II  insufficient  ev-dence  of  its  existence  and  secondarily  of  its  characteristics  The 
existence  of  an  intermediate  term  memory  w in  the  capability  o'  maintaining  recent 
context  factors  m a readily  accessible  state  appears  likely.  The  existence  of  TCLTM  as 
del  red  in  Chapter  S also  appears  likely  to  me  Tne  context  capability  (characteristic) 
of  cognition  is  not  satisfactorily  exp  amed  by  a memory  proposal  solely  involving  the 
classic  Short-term  and  long-term  memories 
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At  for  the  proposa  l relevant  to  tho  explanation  of  human  visual  information 
processing  (imagery,  perception),  several  von  for  research  are  indicated  Further 
investigation  ol  the  role  played  by  an  active  cognitive  goal  in  visual  processing  is 
necessary.  The  effect  of  goals  upon  the  direction  of  attention  and  the  representation 
of  the  realized  perception  requires  further  investigation  and  specification. 

Research  with  regards  to  the  functional  role  of  peripheral  information  m visual 
perception  is  necessary.  One  experiment  could  involve  the  mashing  of  a pre-set 
fixation  area  to  help  determine  the  type  of  information  contained  in  peripheral  inputs 
and  to  what  use  this  information  can  be  put  by  the  visual  system.  Indeed,  can  visual 
form  perception  be  realized  when  only  peripheral  input  is  allowed  ’ If  SO,  how  is  the 
process  altered  * More  neurological  studies  to  determine  nerve  and  nerve -complex 
detection  abilities  of  the  eye  can  also  yield  some  needed  input  to  theory  development. 

Finally,  further  experimentation  is  needed  to  investigate  the  information 
representation  capabilities  of  the  human.  Response  tune  experiments,  operating  under 
the  assumption  that  the  length  of  time  to  derive  an  answer  is  directly  rotated  to  the 
directness  of  the  answer's  representation,  can  yield  veluaolt  results.  Experiments 
which  induce  one  informational  goal  and  then  probe  the  ability  to  answer  unexpected 
questions  concerning  tne  same  body  Ol  information,  may  yield  further  interesting 
results  as  to  the  flexibility  and  specificity  ol  of  human  memory  representations. 

Thus,  by  developing  a completely  operational  visual  system  based  upon  inferences 
made  from  observed  subject  behrvior,  a more  fully  developed  perceptual  theory  is 
here  proposed  then  is  possible  from  more  restricted  experiments.  Though  much  of  the 
theory  is  highly  questionable,  its  value  lies  m the  areas  of  research  which  it  outlines 
fO'  further  inquiry  toward  understanding. 
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